Aug 10 00:31:03 user nova-compute[73029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 10 00:31:05 user nova-compute[73029]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73029) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 10 00:31:05 user nova-compute[73029]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73029) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 10 00:31:05 user nova-compute[73029]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73029) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 10 00:31:05 user nova-compute[73029]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 10 00:31:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:31:06 user nova-compute[73029]: INFO nova.virt.driver [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 10 00:31:06 user nova-compute[73029]: INFO nova.compute.provider_config [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] Acquiring lock "singleton_lock" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] Acquired lock "singleton_lock" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] Releasing lock "singleton_lock" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] Full set of CONF: {{(pid=73029) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ******************************************************************************** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] Configuration options gathered from: {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ================================================================================ {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] allow_resize_to_same_host      = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] arq_binding_timeout            = 300 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] backdoor_port                  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] backdoor_socket                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] block_device_allocate_retries  = 300 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] block_device_allocate_retries_interval = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cert                           = self.pem {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute_monitors               = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] config_dir                     = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] config_drive_format            = iso9660 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] config_source                  = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] console_host                   = user {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] control_exchange               = nova {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cpu_allocation_ratio           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] daemon                         = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] debug                          = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] default_access_ip_network_name = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] default_availability_zone      = nova {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] default_ephemeral_format       = ext4 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] default_schedule_zone          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] disk_allocation_ratio          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] enable_new_services            = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] enabled_ssl_apis               = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] flat_injected                  = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] force_config_drive             = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] force_raw_images               = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] graceful_shutdown_timeout      = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] heal_instance_info_cache_interval = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] host                           = user {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] instance_build_timeout         = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] instance_delete_interval       = 300 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] instance_name_template         = instance-%08x {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] instance_usage_audit           = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] instance_usage_audit_period    = month {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] internal_service_availability_zone = internal {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] key                            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] live_migration_retry_count     = 30 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] log_config_append              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] log_dir                        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] log_file                       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] log_options                    = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] log_rotate_interval            = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] log_rotate_interval_type       = days {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] log_rotation_type              = none {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] long_rpc_timeout               = 1800 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] max_concurrent_builds          = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] max_concurrent_live_migrations = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] max_concurrent_snapshots       = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] max_local_block_devices        = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] max_logfile_count              = 30 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] max_logfile_size_mb            = 200 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] maximum_instance_delete_attempts = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] metadata_listen                = 0.0.0.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] metadata_listen_port           = 8775 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] metadata_workers               = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] migrate_max_retries            = -1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] mkisofs_cmd                    = genisoimage {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] my_ip                          = 10.0.0.210 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] network_allocate_retries       = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] osapi_compute_listen_port      = 8774 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] osapi_compute_unique_server_name_scope =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] osapi_compute_workers          = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] password_length                = 12 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] periodic_enable                = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] periodic_fuzzy_delay           = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] pointer_model                  = ps2mouse {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] preallocate_images             = none {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] publish_errors                 = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] pybasedir                      = /opt/stack/nova {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ram_allocation_ratio           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] rate_limit_burst               = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] rate_limit_except_level        = CRITICAL {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] rate_limit_interval            = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] reboot_timeout                 = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] reclaim_instance_interval      = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] record                         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] reimage_timeout_per_gb         = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] report_interval                = 120 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] rescue_timeout                 = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] reserved_host_cpus             = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] reserved_host_disk_mb          = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] reserved_host_memory_mb        = 512 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] reserved_huge_pages            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] resize_confirm_window          = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] resize_fs_using_block_device   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] resume_guests_state_on_host_boot = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] rpc_response_timeout           = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] run_external_periodic_tasks    = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] running_deleted_instance_action = reap {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] running_deleted_instance_timeout = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler_instance_sync_interval = 120 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_down_time              = 720 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] servicegroup_driver            = db {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] shelved_offload_time           = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] shelved_poll_interval          = 3600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] shutdown_timeout               = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] source_is_ipv6                 = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ssl_only                       = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] state_path                     = /opt/stack/data/nova {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] sync_power_state_interval      = 600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] sync_power_state_pool_size     = 1000 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] syslog_log_facility            = LOG_USER {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] tempdir                        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] timeout_nbd                    = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] transport_url                  = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] update_resources_interval      = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] use_cow_images                 = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] use_eventlog                   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] use_journal                    = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] use_json                       = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] use_rootwrap_daemon            = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] use_stderr                     = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] use_syslog                     = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vcpu_pin_set                   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plugging_is_fatal          = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plugging_timeout           = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] virt_mkfs                      = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] volume_usage_poll_interval     = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] watch_log_file                 = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] web                            = /usr/share/spice-html5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_concurrency.disable_process_locking = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.auth_strategy              = keystone {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.compute_link_prefix        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.dhcp_domain                = novalocal {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.enable_instance_password   = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.glance_link_prefix         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.instance_list_per_project_cells = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.list_records_by_skipping_down_cells = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.local_metadata_per_cell    = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.max_limit                  = 1000 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.metadata_cache_expiration  = 15 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.neutron_default_tenant_id  = default {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.use_forwarded_for          = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.use_neutron_default_nets   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.vendordata_dynamic_targets = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.vendordata_jsonfile_path   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.backend_argument         = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.config_prefix            = cache.oslo {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.dead_timeout             = 60.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.debug_cache_backend      = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.enable_retry_client      = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.enable_socket_keepalive  = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.enabled                  = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.expiration_time          = 600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.hashclient_retry_attempts = 2 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_dead_retry      = 300 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_password        =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_sasl_enabled    = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.memcache_username        =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.proxies                  = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.retry_attempts           = 2 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.retry_delay              = 0.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.socket_keepalive_count   = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.socket_keepalive_idle    = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.socket_keepalive_interval = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.tls_allowed_ciphers      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.tls_cafile               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.tls_certfile             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.tls_enabled              = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cache.tls_keyfile              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.auth_section            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.auth_type               = password {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.cafile                  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.certfile                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.collect_timing          = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.cross_az_attach         = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.debug                   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.endpoint_template       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.http_retries            = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.insecure                = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.keyfile                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.os_region_name          = RegionOne {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.split_loggers           = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cinder.timeout                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.cpu_dedicated_set      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.cpu_shared_set         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.image_type_exclude_list = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.resource_provider_association_refresh = 300 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.shutdown_retry_interval = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] conductor.workers              = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] console.allowed_origins        = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] console.ssl_ciphers            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] console.ssl_minimum_version    = default {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] consoleauth.token_ttl          = 600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.cafile                  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.certfile                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.collect_timing          = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.connect_retries         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.connect_retry_delay     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.endpoint_override       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.insecure                = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.keyfile                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.max_version             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.min_version             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.region_name             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.service_name            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.service_type            = accelerator {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.split_loggers           = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.status_code_retries     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.status_code_retry_delay = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.timeout                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] cyborg.version                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.backend               = sqlalchemy {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.connection            = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.connection_debug      = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.connection_parameters =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.connection_recycle_time = 3600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.connection_trace      = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.db_inc_retry_interval = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.db_max_retries        = 20 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.db_max_retry_interval = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.db_retry_interval     = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.max_overflow          = 50 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.max_pool_size         = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.max_retries           = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.mysql_enable_ndb      = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.mysql_wsrep_sync_wait = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.pool_timeout          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.retry_interval        = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.slave_connection      = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] database.sqlite_synchronous    = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.backend           = sqlalchemy {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.connection        = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.connection_debug  = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.connection_parameters =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.connection_recycle_time = 3600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.connection_trace  = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.db_inc_retry_interval = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.db_max_retries    = 20 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.db_max_retry_interval = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.db_retry_interval = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.max_overflow      = 50 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.max_pool_size     = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.max_retries       = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.mysql_enable_ndb  = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.pool_timeout      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.retry_interval    = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.slave_connection  = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] api_database.sqlite_synchronous = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] devices.enabled_mdev_types     = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ephemeral_storage_encryption.enabled = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.api_servers             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.cafile                  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.certfile                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.collect_timing          = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.connect_retries         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.connect_retry_delay     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.debug                   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.default_trusted_certificate_ids = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.enable_certificate_validation = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.enable_rbd_download     = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.endpoint_override       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.insecure                = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.keyfile                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.max_version             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.min_version             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.num_retries             = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.rbd_ceph_conf           =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.rbd_connect_timeout     = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.rbd_pool                =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.rbd_user                =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.region_name             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.service_name            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.service_type            = image {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.split_loggers           = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.status_code_retries     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.status_code_retry_delay = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.timeout                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.verify_glance_signatures = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] glance.version                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] guestfs.debug                  = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.config_drive_cdrom      = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.config_drive_inject_password = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.enable_remotefx         = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.instances_path_share    =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.limit_cpu_features      = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.use_multipath_io        = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.vswitch_name            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] mks.enabled                    = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] image_cache.manager_interval   = 2400 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] image_cache.precache_concurrency = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] image_cache.remove_unused_base_images = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] image_cache.subdirectory_name  = _base {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.api_max_retries         = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.api_retry_interval      = 2 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.auth_section            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.auth_type               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.cafile                  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.certfile                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.collect_timing          = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.connect_retries         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.connect_retry_delay     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.endpoint_override       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.insecure                = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.keyfile                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.max_version             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.min_version             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.partition_key           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.peer_list               = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.region_name             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.serial_console_state_timeout = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.service_name            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.service_type            = baremetal {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.split_loggers           = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.status_code_retries     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.status_code_retry_delay = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.timeout                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ironic.version                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] key_manager.fixed_key          = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.barbican_api_version  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.barbican_endpoint     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.barbican_endpoint_type = public {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.barbican_region_name  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.cafile                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.certfile              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.collect_timing        = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.insecure              = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.keyfile               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.number_of_retries     = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.retry_delay           = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.send_service_user_token = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.split_loggers         = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.timeout               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.verify_ssl            = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican.verify_ssl_path       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican_service_user.auth_section = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican_service_user.auth_type = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican_service_user.cafile   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican_service_user.certfile = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican_service_user.collect_timing = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican_service_user.insecure = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican_service_user.keyfile  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican_service_user.split_loggers = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] barbican_service_user.timeout  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.approle_role_id          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.approle_secret_id        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.cafile                   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.certfile                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.collect_timing           = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.insecure                 = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.keyfile                  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.kv_mountpoint            = secret {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.kv_version               = 2 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.namespace                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.root_token_id            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.split_loggers            = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.ssl_ca_crt_file          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.timeout                  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.use_ssl                  = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.cafile                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.certfile              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.collect_timing        = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.connect_retries       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.connect_retry_delay   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.endpoint_override     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.insecure              = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.keyfile               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.max_version           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.min_version           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.region_name           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.service_name          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.service_type          = identity {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.split_loggers         = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.status_code_retries   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.status_code_retry_delay = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.timeout               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] keystone.version               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.connection_uri         =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.cpu_mode               = custom {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: WARNING oslo_config.cfg [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.cpu_power_governor_high = performance {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.cpu_power_management   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.device_detach_attempts = 8 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.device_detach_timeout  = 20 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.disk_cachemodes        = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.disk_prefix            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.enabled_perf_events    = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.file_backed_memory     = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.gid_maps               = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.hw_disk_discard        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.hw_machine_type        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.images_rbd_pool        = rbd {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.images_type            = default {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.images_volume_group    = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.inject_key             = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.inject_partition       = -2 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.inject_password        = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.iscsi_iface            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.iser_use_multipath     = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_downtime = 500 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_inbound_addr = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_scheme  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_timeout_action = abort {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_tunnelled = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: WARNING oslo_config.cfg [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 10 00:31:06 user nova-compute[73029]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 10 00:31:06 user nova-compute[73029]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 10 00:31:06 user nova-compute[73029]: and ``live_migration_inbound_addr`` respectively.
Aug 10 00:31:06 user nova-compute[73029]: ).  Its value may be silently ignored in the future.
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.live_migration_with_native_tls = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.max_queues             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.nfs_mount_options      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.num_pcie_ports         = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.pmem_namespaces        = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.quobyte_client_cfg     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rbd_secret_uuid        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rbd_user               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rescue_image_id        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rescue_kernel_id       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.rx_queue_size          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.smbfs_mount_options    =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.snapshot_compression   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.snapshot_image_format  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.sparse_logical_volumes = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.swtpm_enabled          = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.swtpm_group            = tss {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.swtpm_user             = tss {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.sysinfo_serial         = unique {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.tb_cache_size          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.tx_queue_size          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.uid_maps               = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.use_virtio_for_bridges = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.virt_type              = kvm {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.volume_clear           = zero {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.volume_clear_size      = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.volume_use_multipath   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.vzstorage_cache_path   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.auth_section           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.auth_type              = password {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.cafile                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.certfile               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.collect_timing         = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.connect_retries        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.connect_retry_delay    = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.default_floating_pool  = public {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.endpoint_override      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.extension_sync_interval = 600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.http_retries           = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.insecure               = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.keyfile                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.max_version            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.min_version            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.ovs_bridge             = br-int {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.physnets               = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.region_name            = RegionOne {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.service_metadata_proxy = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.service_name           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.service_type           = network {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.split_loggers          = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.status_code_retries    = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.status_code_retry_delay = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.timeout                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] neutron.version                = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] notifications.bdms_in_notifications = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] notifications.default_level    = INFO {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] notifications.notification_format = unversioned {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] notifications.notify_on_state_change = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] pci.alias                      = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] pci.device_spec                = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] pci.report_in_placement        = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.auth_section         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.auth_type            = password {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.cafile               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.certfile             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.collect_timing       = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.connect_retries      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.connect_retry_delay  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.default_domain_id    = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.default_domain_name  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.domain_id            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.domain_name          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.endpoint_override    = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.insecure             = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.keyfile              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.max_version          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.min_version          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.password             = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.project_domain_id    = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.project_domain_name  = Default {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.project_id           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.project_name         = service {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.region_name          = RegionOne {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.service_name         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.service_type         = placement {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.split_loggers        = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.status_code_retries  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.status_code_retry_delay = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.system_scope         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.timeout              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.trust_id             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.user_domain_id       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.user_domain_name     = Default {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.user_id              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.username             = placement {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] placement.version              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.cores                    = 20 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.count_usage_from_placement = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.injected_file_content_bytes = 10240 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.injected_file_path_length = 255 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.injected_files           = 5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.instances                = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.key_pairs                = 100 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.metadata_items           = 128 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.ram                      = 51200 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.recheck_quota            = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.server_group_members     = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] quota.server_groups            = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] rdp.enabled                    = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.image_metadata_prefilter = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.max_attempts         = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.max_placement_results = 1000 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] scheduler.workers              = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.host_subset_size = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.isolated_hosts = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.isolated_images = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.pci_in_placement = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.track_instance_changes = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] metrics.required               = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] metrics.weight_multiplier      = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] metrics.weight_setting         = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] serial_console.enabled         = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] serial_console.port_range      = 10000:20000 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] serial_console.serialproxy_port = 6083 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.auth_section      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.auth_type         = password {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.cafile            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.certfile          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.collect_timing    = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.insecure          = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.keyfile           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.send_service_user_token = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.split_loggers     = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] service_user.timeout           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.agent_enabled            = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.enabled                  = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.html5proxy_port          = 6082 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.image_compression        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.jpeg_compression         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.playback_compression     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.server_listen            = 127.0.0.1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.streaming_mode           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] spice.zlib_compression         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] upgrade_levels.baseapi         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] upgrade_levels.cert            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] upgrade_levels.compute         = auto {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] upgrade_levels.conductor       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] upgrade_levels.scheduler       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vendordata_dynamic_auth.cafile = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vendordata_dynamic_auth.certfile = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vendordata_dynamic_auth.insecure = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vendordata_dynamic_auth.timeout = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.api_retry_count         = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.ca_file                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.cache_prefix            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.cluster_name            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.connection_pool_size    = 10 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.console_delay_seconds   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.datastore_regex         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.host_ip                 = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.host_password           = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.host_port               = 443 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.host_username           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.insecure                = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.integration_bridge      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.maximum_objects         = 100 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.pbm_default_policy      = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.pbm_enabled             = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.pbm_wsdl_location       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.serial_port_proxy_uri   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.serial_port_service_uri = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.task_poll_interval      = 0.5 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.use_linked_clone        = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.vnc_keymap              = en-us {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.vnc_port                = 5900 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vmware.vnc_port_total          = 10000 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.auth_schemes               = ['none'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.enabled                    = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.novncproxy_port            = 6080 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.vencrypt_ca_certs          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.vencrypt_client_cert       = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vnc.vencrypt_client_key        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.disable_rootwrap   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.enable_numa_live_migration = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.libvirt_disable_apic = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.client_socket_timeout     = 900 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.default_pool_size         = 1000 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.keep_alive                = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.max_header_line           = 16384 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.ssl_ca_file               = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.ssl_cert_file             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.ssl_key_file              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.tcp_keepidle              = 600 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] zvm.ca_file                    = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] zvm.cloud_connector_url        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] zvm.reachable_timeout          = 300 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.enforce_new_defaults = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.enforce_scope      = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.policy_default_rule = default {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.connection_string     = messaging:// {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.enabled               = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.es_doc_type           = notification {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.es_scroll_size        = 10000 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.es_scroll_time        = 2m {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.filter_error_trace    = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.hmac_keys             = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.sentinel_service_name = mymaster {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.socket_timeout        = 0.1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.trace_requests        = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler.trace_sqlalchemy      = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler_jaeger.process_tags   = {} {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler_jaeger.service_name_prefix = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] profiler_otlp.service_name_prefix = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] remote_debug.host              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] remote_debug.port              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_notifications.retry = -1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.auth_section        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.auth_type           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.cafile              = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.certfile            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.collect_timing      = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.connect_retries     = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.connect_retry_delay = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.endpoint_id         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.endpoint_override   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.insecure            = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.keyfile             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.max_version         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.min_version         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.region_name         = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.service_name        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.service_type        = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.split_loggers       = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.status_code_retries = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.status_code_retry_delay = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.timeout             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.valid_interfaces    = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_limit.version             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_reports.file_event_handler = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] oslo_reports.log_dir           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_ovs_privileged.group  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] vif_plug_ovs_privileged.user   = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_ovs.isolate_vif         = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] os_brick.lock_path             = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] privsep_osbrick.capabilities   = [21] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] privsep_osbrick.group          = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] privsep_osbrick.helper_command = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] privsep_osbrick.user           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] nova_sys_admin.group           = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] nova_sys_admin.helper_command  = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] nova_sys_admin.user            = None {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG oslo_service.service [None req-1ce522e8-a4ed-42a9-a6b8-fe087fb012d9 None None] ******************************************************************************** {{(pid=73029) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 10 00:31:06 user nova-compute[73029]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 10 00:31:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Starting native event thread {{(pid=73029) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Starting green dispatch thread {{(pid=73029) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Starting connection event dispatch thread {{(pid=73029) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Connecting to libvirt: qemu:///system {{(pid=73029) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7524bf8af0> {{(pid=73029) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 10 00:31:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7524bf8af0> {{(pid=73029) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 10 00:31:06 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Connection event '1' reason 'None'
Aug 10 00:31:06 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 10 00:31:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.mount [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Initialising _HostMountState generation 0 {{(pid=73029) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 10 00:31:13 user nova-compute[73029]: INFO nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt host capabilities <capabilities>
Aug 10 00:31:13 user nova-compute[73029]:   <host>
Aug 10 00:31:13 user nova-compute[73029]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 10 00:31:13 user nova-compute[73029]:     <cpu>
Aug 10 00:31:13 user nova-compute[73029]:       <arch>x86_64</arch>
Aug 10 00:31:13 user nova-compute[73029]:       <model>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <vendor>Intel</vendor>
Aug 10 00:31:13 user nova-compute[73029]:       <microcode version='1070'/>
Aug 10 00:31:13 user nova-compute[73029]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 10 00:31:13 user nova-compute[73029]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='ss'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='vmx'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='pcid'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='osxsave'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='hypervisor'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='arat'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='tsc_adjust'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='md-clear'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='arch-capabilities'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='invtsc'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='rsba'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature name='skip-l1dfl-vmentry'/>
Aug 10 00:31:13 user nova-compute[73029]:       <pages unit='KiB' size='4'/>
Aug 10 00:31:13 user nova-compute[73029]:       <pages unit='KiB' size='2048'/>
Aug 10 00:31:13 user nova-compute[73029]:     </cpu>
Aug 10 00:31:13 user nova-compute[73029]:     <power_management>
Aug 10 00:31:13 user nova-compute[73029]:       <suspend_mem/>
Aug 10 00:31:13 user nova-compute[73029]:       <suspend_disk/>
Aug 10 00:31:13 user nova-compute[73029]:       <suspend_hybrid/>
Aug 10 00:31:13 user nova-compute[73029]:     </power_management>
Aug 10 00:31:13 user nova-compute[73029]:     <iommu support='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     <migration_features>
Aug 10 00:31:13 user nova-compute[73029]:       <live/>
Aug 10 00:31:13 user nova-compute[73029]:       <uri_transports>
Aug 10 00:31:13 user nova-compute[73029]:         <uri_transport>tcp</uri_transport>
Aug 10 00:31:13 user nova-compute[73029]:         <uri_transport>rdma</uri_transport>
Aug 10 00:31:13 user nova-compute[73029]:       </uri_transports>
Aug 10 00:31:13 user nova-compute[73029]:     </migration_features>
Aug 10 00:31:13 user nova-compute[73029]:     <topology>
Aug 10 00:31:13 user nova-compute[73029]:       <cells num='2'>
Aug 10 00:31:13 user nova-compute[73029]:         <cell id='0'>
Aug 10 00:31:13 user nova-compute[73029]:           <memory unit='KiB'>8189224</memory>
Aug 10 00:31:13 user nova-compute[73029]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 10 00:31:13 user nova-compute[73029]:           <pages unit='KiB' size='2048'>0</pages>
Aug 10 00:31:13 user nova-compute[73029]:           <distances>
Aug 10 00:31:13 user nova-compute[73029]:             <sibling id='0' value='10'/>
Aug 10 00:31:13 user nova-compute[73029]:             <sibling id='1' value='20'/>
Aug 10 00:31:13 user nova-compute[73029]:           </distances>
Aug 10 00:31:13 user nova-compute[73029]:           <cpus num='6'>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 10 00:31:13 user nova-compute[73029]:           </cpus>
Aug 10 00:31:13 user nova-compute[73029]:         </cell>
Aug 10 00:31:13 user nova-compute[73029]:         <cell id='1'>
Aug 10 00:31:13 user nova-compute[73029]:           <memory unit='KiB'>8206460</memory>
Aug 10 00:31:13 user nova-compute[73029]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 10 00:31:13 user nova-compute[73029]:           <pages unit='KiB' size='2048'>0</pages>
Aug 10 00:31:13 user nova-compute[73029]:           <distances>
Aug 10 00:31:13 user nova-compute[73029]:             <sibling id='0' value='20'/>
Aug 10 00:31:13 user nova-compute[73029]:             <sibling id='1' value='10'/>
Aug 10 00:31:13 user nova-compute[73029]:           </distances>
Aug 10 00:31:13 user nova-compute[73029]:           <cpus num='6'>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 10 00:31:13 user nova-compute[73029]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 10 00:31:13 user nova-compute[73029]:           </cpus>
Aug 10 00:31:13 user nova-compute[73029]:         </cell>
Aug 10 00:31:13 user nova-compute[73029]:       </cells>
Aug 10 00:31:13 user nova-compute[73029]:     </topology>
Aug 10 00:31:13 user nova-compute[73029]:     <cache>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 10 00:31:13 user nova-compute[73029]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 10 00:31:13 user nova-compute[73029]:     </cache>
Aug 10 00:31:13 user nova-compute[73029]:     <secmodel>
Aug 10 00:31:13 user nova-compute[73029]:       <model>apparmor</model>
Aug 10 00:31:13 user nova-compute[73029]:       <doi>0</doi>
Aug 10 00:31:13 user nova-compute[73029]:     </secmodel>
Aug 10 00:31:13 user nova-compute[73029]:     <secmodel>
Aug 10 00:31:13 user nova-compute[73029]:       <model>dac</model>
Aug 10 00:31:13 user nova-compute[73029]:       <doi>0</doi>
Aug 10 00:31:13 user nova-compute[73029]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 10 00:31:13 user nova-compute[73029]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 10 00:31:13 user nova-compute[73029]:     </secmodel>
Aug 10 00:31:13 user nova-compute[73029]:   </host>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='alpha'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>clipper</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='armv6l'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>integratorcp</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>borzoi</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>spitz</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>nuri</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>musca-b1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>versatileab</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>kzm</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>musca-a</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>smdkc210</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sx1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>z2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>tosa</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>sabrelite</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>realview-eb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>n810</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>n800</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>versatilepb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>terrier</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mainstone</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>midway</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>musicpal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>microbit</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>cubieboard</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>verdex</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>netduino2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>raspi2b</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>cheetah</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>highbank</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>akita</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>connex</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>collie</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>raspi0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='armv7l'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>integratorcp</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>borzoi</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>spitz</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>nuri</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>musca-b1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>versatileab</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>kzm</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>musca-a</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>smdkc210</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sx1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>z2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>tosa</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>sabrelite</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>realview-eb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>n810</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>n800</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>versatilepb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>terrier</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mainstone</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>midway</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>musicpal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>microbit</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>cubieboard</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>verdex</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>netduino2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>raspi2b</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>cheetah</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>highbank</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>akita</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>connex</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>collie</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>raspi0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='aarch64'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>integratorcp</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>borzoi</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>spitz</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>nuri</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>musca-b1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>versatileab</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>kzm</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>musca-a</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>smdkc210</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sx1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>z2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>tosa</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>sabrelite</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>realview-eb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>n810</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>n800</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>versatilepb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>terrier</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mainstone</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>midway</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>musicpal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>microbit</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>cubieboard</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>verdex</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>netduino2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>raspi3b</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>raspi2b</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>cheetah</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>highbank</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>akita</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>connex</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>collie</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>raspi0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <acpi default='on' toggle='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='cris'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='i686'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>x-remote</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>isapc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>microvm</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='kvm'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <pae/>
Aug 10 00:31:13 user nova-compute[73029]:       <nonpae/>
Aug 10 00:31:13 user nova-compute[73029]:       <acpi default='on' toggle='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:       <apic default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='m68k'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>an5206</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>q800</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>next-cube</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='microblaze'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='microblazeel'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='mips'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='16'>malta</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mipssim</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='mipsel'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='16'>malta</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mipssim</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='mips64'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='16'>malta</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mipssim</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>pica61</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>magnum</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='mips64el'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='16'>malta</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mipssim</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>pica61</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>magnum</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='16'>boston</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='ppc'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>g3beige</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mac99</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>ppce500</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>pegasos2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sam460ex</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>bamboo</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>40p</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>ref405ep</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>taihu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='ppc64'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2048'>powernv9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>taihu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2048'>powernv10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>ppce500</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>40p</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>pegasos2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>bamboo</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>g3beige</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mac99</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sam460ex</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>ref405ep</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2048'>powernv8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='ppc64le'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2048'>powernv9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>taihu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2048'>powernv10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>ppce500</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>40p</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>pegasos2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>bamboo</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>g3beige</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>mac99</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sam460ex</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>ref405ep</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2048'>powernv8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='riscv32'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='8'>spike</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>opentitan</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='5'>sifive_u</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sifive_e</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='8'>virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='riscv64'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='8'>spike</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='5'>sifive_u</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>shakti_c</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sifive_e</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='8'>virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='s390x'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='sh4'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>shix</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>r2d</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='sh4eb'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>shix</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>r2d</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='sparc'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>SS-5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>SS-20</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>LX</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>SS-4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>SS-10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>Voyager</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='sparc64'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sun4u</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>niagara</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>sun4v</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='x86_64'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>64</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>x-remote</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='1'>isapc</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>microvm</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='kvm'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <acpi default='on' toggle='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:       <apic default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='xtensa'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>sim</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>kc705</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>ml605</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>lx200</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>lx60</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]:   <guest>
Aug 10 00:31:13 user nova-compute[73029]:     <os_type>hvm</os_type>
Aug 10 00:31:13 user nova-compute[73029]:     <arch name='xtensaeb'>
Aug 10 00:31:13 user nova-compute[73029]:       <wordsize>32</wordsize>
Aug 10 00:31:13 user nova-compute[73029]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='4'>sim</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>kc705</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>ml605</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>virt</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>lx200</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>lx60</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 10 00:31:13 user nova-compute[73029]:       <domain type='qemu'/>
Aug 10 00:31:13 user nova-compute[73029]:     </arch>
Aug 10 00:31:13 user nova-compute[73029]:     <features>
Aug 10 00:31:13 user nova-compute[73029]:       <cpuselection/>
Aug 10 00:31:13 user nova-compute[73029]:       <deviceboot/>
Aug 10 00:31:13 user nova-compute[73029]:       <disksnapshot default='on' toggle='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     </features>
Aug 10 00:31:13 user nova-compute[73029]:   </guest>
Aug 10 00:31:13 user nova-compute[73029]: </capabilities>
Aug 10 00:31:13 user nova-compute[73029]: 
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 10 00:31:13 user nova-compute[73029]: <domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:   <path>/usr/bin/qemu-system-i386</path>
Aug 10 00:31:13 user nova-compute[73029]:   <domain>kvm</domain>
Aug 10 00:31:13 user nova-compute[73029]:   <machine>pc-i440fx-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:   <arch>i686</arch>
Aug 10 00:31:13 user nova-compute[73029]:   <vcpu max='255'/>
Aug 10 00:31:13 user nova-compute[73029]:   <iothreads supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:   <os supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='firmware'/>
Aug 10 00:31:13 user nova-compute[73029]:     <loader supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>rom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pflash</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='readonly'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='secure'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </loader>
Aug 10 00:31:13 user nova-compute[73029]:   </os>
Aug 10 00:31:13 user nova-compute[73029]:   <cpu>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-passthrough' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='hostPassthroughMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='maximum' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='maximumMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-model' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <vendor>Intel</vendor>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ss'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='vmx'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pcid'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='hypervisor'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arat'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='tsc_adjust'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='umip'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='md-clear'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arch-capabilities'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibpb'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibrs'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='erms'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='xsaveopt'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='lm'/>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='custom' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>qemu64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>qemu32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>phenom</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>n270</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>kvm64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>coreduo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>core2duo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>athlon</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Westmere-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Westmere</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Snowridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Penryn</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G5</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G4</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G1</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Nehalem-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Nehalem</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Rome</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Milan</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-IBPB</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Dhyana</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cooperlake</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Conroe</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>486</model>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:   </cpu>
Aug 10 00:31:13 user nova-compute[73029]:   <memoryBacking supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='sourceType'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>file</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>anonymous</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>memfd</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:   </memoryBacking>
Aug 10 00:31:13 user nova-compute[73029]:   <devices>
Aug 10 00:31:13 user nova-compute[73029]:     <disk supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='diskDevice'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>disk</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cdrom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>floppy</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>lun</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='bus'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ide</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>fdc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sata</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </disk>
Aug 10 00:31:13 user nova-compute[73029]:     <graphics supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sdl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vnc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>spice</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egl-headless</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </graphics>
Aug 10 00:31:13 user nova-compute[73029]:     <video supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='modelType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cirrus</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vmvga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>qxl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>none</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>bochs</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ramfb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </video>
Aug 10 00:31:13 user nova-compute[73029]:     <hostdev supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='mode'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>subsystem</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='startupPolicy'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>default</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>mandatory</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>requisite</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>optional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='subsysType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pci</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='capsType'/>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='pciBackend'/>
Aug 10 00:31:13 user nova-compute[73029]:     </hostdev>
Aug 10 00:31:13 user nova-compute[73029]:     <rng supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>random</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egd</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>builtin</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </rng>
Aug 10 00:31:13 user nova-compute[73029]:     <filesystem supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='driverType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>path</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>handle</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtiofs</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </filesystem>
Aug 10 00:31:13 user nova-compute[73029]:     <tpm supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-tis</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-crb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>passthrough</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>emulator</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </tpm>
Aug 10 00:31:13 user nova-compute[73029]:   </devices>
Aug 10 00:31:13 user nova-compute[73029]:   <features>
Aug 10 00:31:13 user nova-compute[73029]:     <gic supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     <vmcoreinfo supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <genid supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backingStoreInput supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backup supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <sev supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:   </features>
Aug 10 00:31:13 user nova-compute[73029]: </domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:  {{(pid=73029) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 10 00:31:13 user nova-compute[73029]: <domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:   <path>/usr/bin/qemu-system-i386</path>
Aug 10 00:31:13 user nova-compute[73029]:   <domain>kvm</domain>
Aug 10 00:31:13 user nova-compute[73029]:   <machine>pc-i440fx-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:   <arch>i686</arch>
Aug 10 00:31:13 user nova-compute[73029]:   <vcpu max='255'/>
Aug 10 00:31:13 user nova-compute[73029]:   <iothreads supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:   <os supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='firmware'/>
Aug 10 00:31:13 user nova-compute[73029]:     <loader supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>rom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pflash</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='readonly'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='secure'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </loader>
Aug 10 00:31:13 user nova-compute[73029]:   </os>
Aug 10 00:31:13 user nova-compute[73029]:   <cpu>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-passthrough' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='hostPassthroughMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='maximum' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='maximumMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-model' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <vendor>Intel</vendor>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ss'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='vmx'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pcid'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='hypervisor'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arat'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='tsc_adjust'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='umip'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='md-clear'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arch-capabilities'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibpb'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibrs'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='erms'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='xsaveopt'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='lm'/>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='custom' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>qemu64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>qemu32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>phenom</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>n270</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>kvm64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>coreduo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>core2duo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>athlon</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Westmere-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Westmere</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Snowridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Penryn</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G5</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G4</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G1</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Nehalem-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Nehalem</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Rome</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Milan</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-IBPB</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Dhyana</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cooperlake</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Conroe</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>486</model>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:   </cpu>
Aug 10 00:31:13 user nova-compute[73029]:   <memoryBacking supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='sourceType'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>file</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>anonymous</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>memfd</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:   </memoryBacking>
Aug 10 00:31:13 user nova-compute[73029]:   <devices>
Aug 10 00:31:13 user nova-compute[73029]:     <disk supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='diskDevice'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>disk</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cdrom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>floppy</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>lun</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='bus'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ide</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>fdc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sata</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </disk>
Aug 10 00:31:13 user nova-compute[73029]:     <graphics supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sdl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vnc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>spice</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egl-headless</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </graphics>
Aug 10 00:31:13 user nova-compute[73029]:     <video supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='modelType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cirrus</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vmvga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>qxl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>none</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>bochs</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ramfb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </video>
Aug 10 00:31:13 user nova-compute[73029]:     <hostdev supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='mode'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>subsystem</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='startupPolicy'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>default</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>mandatory</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>requisite</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>optional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='subsysType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pci</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='capsType'/>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='pciBackend'/>
Aug 10 00:31:13 user nova-compute[73029]:     </hostdev>
Aug 10 00:31:13 user nova-compute[73029]:     <rng supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>random</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egd</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>builtin</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </rng>
Aug 10 00:31:13 user nova-compute[73029]:     <filesystem supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='driverType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>path</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>handle</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtiofs</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </filesystem>
Aug 10 00:31:13 user nova-compute[73029]:     <tpm supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-tis</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-crb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>passthrough</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>emulator</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </tpm>
Aug 10 00:31:13 user nova-compute[73029]:   </devices>
Aug 10 00:31:13 user nova-compute[73029]:   <features>
Aug 10 00:31:13 user nova-compute[73029]:     <gic supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     <vmcoreinfo supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <genid supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backingStoreInput supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backup supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <sev supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:   </features>
Aug 10 00:31:13 user nova-compute[73029]: </domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:  {{(pid=73029) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 10 00:31:13 user nova-compute[73029]: <domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:   <path>/usr/bin/qemu-system-i386</path>
Aug 10 00:31:13 user nova-compute[73029]:   <domain>kvm</domain>
Aug 10 00:31:13 user nova-compute[73029]:   <machine>pc-q35-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:   <arch>i686</arch>
Aug 10 00:31:13 user nova-compute[73029]:   <vcpu max='288'/>
Aug 10 00:31:13 user nova-compute[73029]:   <iothreads supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:   <os supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='firmware'/>
Aug 10 00:31:13 user nova-compute[73029]:     <loader supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>rom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pflash</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='readonly'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='secure'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </loader>
Aug 10 00:31:13 user nova-compute[73029]:   </os>
Aug 10 00:31:13 user nova-compute[73029]:   <cpu>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-passthrough' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='hostPassthroughMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='maximum' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='maximumMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-model' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <vendor>Intel</vendor>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ss'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='vmx'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pcid'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='hypervisor'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arat'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='tsc_adjust'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='umip'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='md-clear'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arch-capabilities'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibpb'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibrs'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='erms'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='xsaveopt'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='lm'/>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='custom' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>qemu64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>qemu32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>phenom</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>n270</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>kvm64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>coreduo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>core2duo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>athlon</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Westmere-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Westmere</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Snowridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Penryn</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G5</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G4</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G1</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Nehalem-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Nehalem</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Rome</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Milan</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-IBPB</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Dhyana</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cooperlake</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Conroe</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>486</model>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:   </cpu>
Aug 10 00:31:13 user nova-compute[73029]:   <memoryBacking supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='sourceType'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>file</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>anonymous</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>memfd</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:   </memoryBacking>
Aug 10 00:31:13 user nova-compute[73029]:   <devices>
Aug 10 00:31:13 user nova-compute[73029]:     <disk supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='diskDevice'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>disk</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cdrom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>floppy</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>lun</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='bus'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>fdc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sata</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </disk>
Aug 10 00:31:13 user nova-compute[73029]:     <graphics supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sdl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vnc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>spice</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egl-headless</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </graphics>
Aug 10 00:31:13 user nova-compute[73029]:     <video supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='modelType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cirrus</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vmvga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>qxl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>none</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>bochs</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ramfb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </video>
Aug 10 00:31:13 user nova-compute[73029]:     <hostdev supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='mode'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>subsystem</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='startupPolicy'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>default</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>mandatory</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>requisite</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>optional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='subsysType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pci</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='capsType'/>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='pciBackend'/>
Aug 10 00:31:13 user nova-compute[73029]:     </hostdev>
Aug 10 00:31:13 user nova-compute[73029]:     <rng supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>random</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egd</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>builtin</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </rng>
Aug 10 00:31:13 user nova-compute[73029]:     <filesystem supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='driverType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>path</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>handle</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtiofs</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </filesystem>
Aug 10 00:31:13 user nova-compute[73029]:     <tpm supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-tis</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-crb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>passthrough</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>emulator</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </tpm>
Aug 10 00:31:13 user nova-compute[73029]:   </devices>
Aug 10 00:31:13 user nova-compute[73029]:   <features>
Aug 10 00:31:13 user nova-compute[73029]:     <gic supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     <vmcoreinfo supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <genid supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backingStoreInput supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backup supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <sev supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:   </features>
Aug 10 00:31:13 user nova-compute[73029]: </domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:  {{(pid=73029) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 10 00:31:13 user nova-compute[73029]: <domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:   <path>/usr/bin/qemu-system-i386</path>
Aug 10 00:31:13 user nova-compute[73029]:   <domain>kvm</domain>
Aug 10 00:31:13 user nova-compute[73029]:   <machine>pc-q35-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:   <arch>i686</arch>
Aug 10 00:31:13 user nova-compute[73029]:   <vcpu max='288'/>
Aug 10 00:31:13 user nova-compute[73029]:   <iothreads supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:   <os supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='firmware'/>
Aug 10 00:31:13 user nova-compute[73029]:     <loader supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>rom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pflash</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='readonly'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='secure'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </loader>
Aug 10 00:31:13 user nova-compute[73029]:   </os>
Aug 10 00:31:13 user nova-compute[73029]:   <cpu>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-passthrough' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='hostPassthroughMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='maximum' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='maximumMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-model' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <vendor>Intel</vendor>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ss'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='vmx'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pcid'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='hypervisor'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arat'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='tsc_adjust'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='umip'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='md-clear'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arch-capabilities'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibpb'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibrs'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='erms'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='xsaveopt'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='lm'/>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='custom' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>qemu64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>qemu32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>phenom</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>n270</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>kvm64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>coreduo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>core2duo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>athlon</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Westmere-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Westmere</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Snowridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Penryn</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G5</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G4</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G1</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Nehalem-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Nehalem</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Rome</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Milan</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-IBPB</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Dhyana</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cooperlake</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Conroe</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>486</model>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:   </cpu>
Aug 10 00:31:13 user nova-compute[73029]:   <memoryBacking supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='sourceType'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>file</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>anonymous</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>memfd</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:   </memoryBacking>
Aug 10 00:31:13 user nova-compute[73029]:   <devices>
Aug 10 00:31:13 user nova-compute[73029]:     <disk supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='diskDevice'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>disk</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cdrom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>floppy</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>lun</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='bus'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>fdc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sata</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </disk>
Aug 10 00:31:13 user nova-compute[73029]:     <graphics supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sdl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vnc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>spice</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egl-headless</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </graphics>
Aug 10 00:31:13 user nova-compute[73029]:     <video supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='modelType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cirrus</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vmvga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>qxl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>none</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>bochs</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ramfb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </video>
Aug 10 00:31:13 user nova-compute[73029]:     <hostdev supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='mode'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>subsystem</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='startupPolicy'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>default</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>mandatory</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>requisite</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>optional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='subsysType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pci</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='capsType'/>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='pciBackend'/>
Aug 10 00:31:13 user nova-compute[73029]:     </hostdev>
Aug 10 00:31:13 user nova-compute[73029]:     <rng supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>random</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egd</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>builtin</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </rng>
Aug 10 00:31:13 user nova-compute[73029]:     <filesystem supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='driverType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>path</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>handle</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtiofs</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </filesystem>
Aug 10 00:31:13 user nova-compute[73029]:     <tpm supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-tis</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-crb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>passthrough</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>emulator</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </tpm>
Aug 10 00:31:13 user nova-compute[73029]:   </devices>
Aug 10 00:31:13 user nova-compute[73029]:   <features>
Aug 10 00:31:13 user nova-compute[73029]:     <gic supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     <vmcoreinfo supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <genid supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backingStoreInput supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backup supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <sev supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:   </features>
Aug 10 00:31:13 user nova-compute[73029]: </domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:  {{(pid=73029) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 10 00:31:13 user nova-compute[73029]: <domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 10 00:31:13 user nova-compute[73029]:   <domain>kvm</domain>
Aug 10 00:31:13 user nova-compute[73029]:   <machine>pc-i440fx-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:   <arch>x86_64</arch>
Aug 10 00:31:13 user nova-compute[73029]:   <vcpu max='255'/>
Aug 10 00:31:13 user nova-compute[73029]:   <iothreads supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:   <os supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='firmware'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>efi</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:     <loader supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>rom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pflash</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='readonly'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='secure'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </loader>
Aug 10 00:31:13 user nova-compute[73029]:   </os>
Aug 10 00:31:13 user nova-compute[73029]:   <cpu>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-passthrough' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='hostPassthroughMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='maximum' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='maximumMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-model' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <vendor>Intel</vendor>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ss'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='vmx'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pcid'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='hypervisor'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arat'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='tsc_adjust'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='umip'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='md-clear'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arch-capabilities'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='invtsc'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibpb'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibrs'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='rsba'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pschange-mc-no'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='erms'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='xsaveopt'/>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='custom' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>qemu64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>qemu32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>phenom</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>n270</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>coreduo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>core2duo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>athlon</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Westmere-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Westmere</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Snowridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Penryn</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G5</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G4</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Opteron_G1</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Nehalem</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Rome</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Milan</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-IBPB</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Dhyana</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cooperlake</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Conroe</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>486</model>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:   </cpu>
Aug 10 00:31:13 user nova-compute[73029]:   <memoryBacking supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='sourceType'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>file</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>anonymous</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>memfd</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:   </memoryBacking>
Aug 10 00:31:13 user nova-compute[73029]:   <devices>
Aug 10 00:31:13 user nova-compute[73029]:     <disk supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='diskDevice'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>disk</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cdrom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>floppy</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>lun</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='bus'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ide</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>fdc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sata</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </disk>
Aug 10 00:31:13 user nova-compute[73029]:     <graphics supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sdl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vnc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>spice</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egl-headless</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </graphics>
Aug 10 00:31:13 user nova-compute[73029]:     <video supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='modelType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cirrus</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vmvga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>qxl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>none</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>bochs</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ramfb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </video>
Aug 10 00:31:13 user nova-compute[73029]:     <hostdev supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='mode'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>subsystem</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='startupPolicy'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>default</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>mandatory</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>requisite</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>optional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='subsysType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pci</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='capsType'/>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='pciBackend'/>
Aug 10 00:31:13 user nova-compute[73029]:     </hostdev>
Aug 10 00:31:13 user nova-compute[73029]:     <rng supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>random</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egd</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>builtin</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </rng>
Aug 10 00:31:13 user nova-compute[73029]:     <filesystem supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='driverType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>path</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>handle</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtiofs</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </filesystem>
Aug 10 00:31:13 user nova-compute[73029]:     <tpm supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-tis</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-crb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>passthrough</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>emulator</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </tpm>
Aug 10 00:31:13 user nova-compute[73029]:   </devices>
Aug 10 00:31:13 user nova-compute[73029]:   <features>
Aug 10 00:31:13 user nova-compute[73029]:     <gic supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     <vmcoreinfo supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <genid supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backingStoreInput supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backup supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <sev supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:   </features>
Aug 10 00:31:13 user nova-compute[73029]: </domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:  {{(pid=73029) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 10 00:31:13 user nova-compute[73029]: <domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 10 00:31:13 user nova-compute[73029]:   <domain>kvm</domain>
Aug 10 00:31:13 user nova-compute[73029]:   <machine>pc-i440fx-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:   <arch>x86_64</arch>
Aug 10 00:31:13 user nova-compute[73029]:   <vcpu max='255'/>
Aug 10 00:31:13 user nova-compute[73029]:   <iothreads supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:   <os supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='firmware'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>efi</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:     <loader supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>rom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pflash</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='readonly'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='secure'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </loader>
Aug 10 00:31:13 user nova-compute[73029]:   </os>
Aug 10 00:31:13 user nova-compute[73029]:   <cpu>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-passthrough' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='hostPassthroughMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='maximum' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='maximumMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-model' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <vendor>Intel</vendor>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ss'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='vmx'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pcid'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='hypervisor'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arat'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='tsc_adjust'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='umip'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='md-clear'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arch-capabilities'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='invtsc'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibpb'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibrs'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='rsba'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pschange-mc-no'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='erms'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='xsaveopt'/>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='custom' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>qemu64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>qemu32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>phenom</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>n270</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>coreduo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>core2duo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>athlon</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Westmere-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Westmere</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Snowridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Penryn</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G5</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G4</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Opteron_G1</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Nehalem</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Rome</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Milan</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-IBPB</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Dhyana</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cooperlake</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Conroe</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>486</model>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:   </cpu>
Aug 10 00:31:13 user nova-compute[73029]:   <memoryBacking supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='sourceType'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>file</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>anonymous</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>memfd</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:   </memoryBacking>
Aug 10 00:31:13 user nova-compute[73029]:   <devices>
Aug 10 00:31:13 user nova-compute[73029]:     <disk supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='diskDevice'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>disk</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cdrom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>floppy</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>lun</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='bus'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ide</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>fdc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sata</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </disk>
Aug 10 00:31:13 user nova-compute[73029]:     <graphics supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sdl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vnc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>spice</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egl-headless</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </graphics>
Aug 10 00:31:13 user nova-compute[73029]:     <video supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='modelType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cirrus</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vmvga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>qxl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>none</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>bochs</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ramfb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </video>
Aug 10 00:31:13 user nova-compute[73029]:     <hostdev supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='mode'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>subsystem</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='startupPolicy'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>default</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>mandatory</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>requisite</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>optional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='subsysType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pci</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='capsType'/>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='pciBackend'/>
Aug 10 00:31:13 user nova-compute[73029]:     </hostdev>
Aug 10 00:31:13 user nova-compute[73029]:     <rng supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>random</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egd</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>builtin</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </rng>
Aug 10 00:31:13 user nova-compute[73029]:     <filesystem supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='driverType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>path</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>handle</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtiofs</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </filesystem>
Aug 10 00:31:13 user nova-compute[73029]:     <tpm supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-tis</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-crb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>passthrough</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>emulator</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </tpm>
Aug 10 00:31:13 user nova-compute[73029]:   </devices>
Aug 10 00:31:13 user nova-compute[73029]:   <features>
Aug 10 00:31:13 user nova-compute[73029]:     <gic supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     <vmcoreinfo supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <genid supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backingStoreInput supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backup supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <sev supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:   </features>
Aug 10 00:31:13 user nova-compute[73029]: </domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:  {{(pid=73029) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 10 00:31:13 user nova-compute[73029]: <domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 10 00:31:13 user nova-compute[73029]:   <domain>kvm</domain>
Aug 10 00:31:13 user nova-compute[73029]:   <machine>pc-q35-jammy</machine>
Aug 10 00:31:13 user nova-compute[73029]:   <arch>x86_64</arch>
Aug 10 00:31:13 user nova-compute[73029]:   <vcpu max='288'/>
Aug 10 00:31:13 user nova-compute[73029]:   <iothreads supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:   <os supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='firmware'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>efi</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:     <loader supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>rom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pflash</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='readonly'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='secure'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </loader>
Aug 10 00:31:13 user nova-compute[73029]:   </os>
Aug 10 00:31:13 user nova-compute[73029]:   <cpu>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-passthrough' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='hostPassthroughMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='maximum' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='maximumMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-model' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <vendor>Intel</vendor>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ss'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='vmx'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pcid'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='hypervisor'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arat'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='tsc_adjust'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='umip'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='md-clear'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arch-capabilities'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='invtsc'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibpb'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibrs'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='rsba'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pschange-mc-no'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='erms'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='xsaveopt'/>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='custom' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>qemu64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>qemu32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>phenom</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>n270</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>coreduo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>core2duo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>athlon</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Westmere-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Westmere</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Snowridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Penryn</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G5</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G4</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Opteron_G1</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Nehalem</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Rome</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Milan</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-IBPB</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Dhyana</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cooperlake</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Conroe</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>486</model>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:   </cpu>
Aug 10 00:31:13 user nova-compute[73029]:   <memoryBacking supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='sourceType'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>file</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>anonymous</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>memfd</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:   </memoryBacking>
Aug 10 00:31:13 user nova-compute[73029]:   <devices>
Aug 10 00:31:13 user nova-compute[73029]:     <disk supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='diskDevice'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>disk</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cdrom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>floppy</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>lun</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='bus'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>fdc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sata</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </disk>
Aug 10 00:31:13 user nova-compute[73029]:     <graphics supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sdl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vnc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>spice</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egl-headless</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </graphics>
Aug 10 00:31:13 user nova-compute[73029]:     <video supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='modelType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cirrus</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vmvga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>qxl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>none</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>bochs</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ramfb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </video>
Aug 10 00:31:13 user nova-compute[73029]:     <hostdev supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='mode'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>subsystem</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='startupPolicy'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>default</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>mandatory</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>requisite</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>optional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='subsysType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pci</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='capsType'/>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='pciBackend'/>
Aug 10 00:31:13 user nova-compute[73029]:     </hostdev>
Aug 10 00:31:13 user nova-compute[73029]:     <rng supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>random</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egd</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>builtin</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </rng>
Aug 10 00:31:13 user nova-compute[73029]:     <filesystem supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='driverType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>path</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>handle</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtiofs</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </filesystem>
Aug 10 00:31:13 user nova-compute[73029]:     <tpm supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-tis</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-crb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>passthrough</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>emulator</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </tpm>
Aug 10 00:31:13 user nova-compute[73029]:   </devices>
Aug 10 00:31:13 user nova-compute[73029]:   <features>
Aug 10 00:31:13 user nova-compute[73029]:     <gic supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     <vmcoreinfo supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <genid supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backingStoreInput supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backup supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <sev supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:   </features>
Aug 10 00:31:13 user nova-compute[73029]: </domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:  {{(pid=73029) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 10 00:31:13 user nova-compute[73029]: <domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 10 00:31:13 user nova-compute[73029]:   <domain>kvm</domain>
Aug 10 00:31:13 user nova-compute[73029]:   <machine>pc-q35-6.2</machine>
Aug 10 00:31:13 user nova-compute[73029]:   <arch>x86_64</arch>
Aug 10 00:31:13 user nova-compute[73029]:   <vcpu max='288'/>
Aug 10 00:31:13 user nova-compute[73029]:   <iothreads supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:   <os supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='firmware'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>efi</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:     <loader supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>rom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pflash</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='readonly'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='secure'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>yes</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>no</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </loader>
Aug 10 00:31:13 user nova-compute[73029]:   </os>
Aug 10 00:31:13 user nova-compute[73029]:   <cpu>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-passthrough' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='hostPassthroughMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='maximum' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='maximumMigratable'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>on</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>off</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='host-model' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <vendor>Intel</vendor>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ss'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='vmx'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pcid'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='hypervisor'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arat'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='tsc_adjust'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='umip'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='md-clear'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='arch-capabilities'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='invtsc'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibpb'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='ibrs'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-stibp'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='amd-ssbd'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='rsba'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='require' name='pschange-mc-no'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='erms'/>
Aug 10 00:31:13 user nova-compute[73029]:       <feature policy='disable' name='xsaveopt'/>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:     <mode name='custom' supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>qemu64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>qemu32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>phenom</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>pentium</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>n270</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm64</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>kvm32</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>coreduo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>core2duo</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>athlon</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Westmere-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Westmere</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Snowridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Skylake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>SandyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Penryn</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G5</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G4</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G3</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Opteron_G2</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Opteron_G1</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Nehalem</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>IvyBridge</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Icelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Haswell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Rome</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-Milan</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC-IBPB</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>EPYC</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Dhyana</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cooperlake</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>Conroe</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Cascadelake-Server</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-noTSX</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell-IBRS</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='no'>Broadwell</model>
Aug 10 00:31:13 user nova-compute[73029]:       <model usable='yes'>486</model>
Aug 10 00:31:13 user nova-compute[73029]:     </mode>
Aug 10 00:31:13 user nova-compute[73029]:   </cpu>
Aug 10 00:31:13 user nova-compute[73029]:   <memoryBacking supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:     <enum name='sourceType'>
Aug 10 00:31:13 user nova-compute[73029]:       <value>file</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>anonymous</value>
Aug 10 00:31:13 user nova-compute[73029]:       <value>memfd</value>
Aug 10 00:31:13 user nova-compute[73029]:     </enum>
Aug 10 00:31:13 user nova-compute[73029]:   </memoryBacking>
Aug 10 00:31:13 user nova-compute[73029]:   <devices>
Aug 10 00:31:13 user nova-compute[73029]:     <disk supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='diskDevice'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>disk</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cdrom</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>floppy</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>lun</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='bus'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>fdc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sata</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </disk>
Aug 10 00:31:13 user nova-compute[73029]:     <graphics supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='type'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>sdl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vnc</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>spice</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egl-headless</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </graphics>
Aug 10 00:31:13 user nova-compute[73029]:     <video supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='modelType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>cirrus</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>vmvga</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>qxl</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>none</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>bochs</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>ramfb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </video>
Aug 10 00:31:13 user nova-compute[73029]:     <hostdev supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='mode'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>subsystem</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='startupPolicy'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>default</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>mandatory</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>requisite</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>optional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='subsysType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>usb</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>pci</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>scsi</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='capsType'/>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='pciBackend'/>
Aug 10 00:31:13 user nova-compute[73029]:     </hostdev>
Aug 10 00:31:13 user nova-compute[73029]:     <rng supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtio-non-transitional</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>random</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>egd</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>builtin</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </rng>
Aug 10 00:31:13 user nova-compute[73029]:     <filesystem supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='driverType'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>path</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>handle</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>virtiofs</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </filesystem>
Aug 10 00:31:13 user nova-compute[73029]:     <tpm supported='yes'>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='model'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-tis</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>tpm-crb</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:       <enum name='backendModel'>
Aug 10 00:31:13 user nova-compute[73029]:         <value>passthrough</value>
Aug 10 00:31:13 user nova-compute[73029]:         <value>emulator</value>
Aug 10 00:31:13 user nova-compute[73029]:       </enum>
Aug 10 00:31:13 user nova-compute[73029]:     </tpm>
Aug 10 00:31:13 user nova-compute[73029]:   </devices>
Aug 10 00:31:13 user nova-compute[73029]:   <features>
Aug 10 00:31:13 user nova-compute[73029]:     <gic supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:     <vmcoreinfo supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <genid supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backingStoreInput supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <backup supported='yes'/>
Aug 10 00:31:13 user nova-compute[73029]:     <sev supported='no'/>
Aug 10 00:31:13 user nova-compute[73029]:   </features>
Aug 10 00:31:13 user nova-compute[73029]: </domainCapabilities>
Aug 10 00:31:13 user nova-compute[73029]:  {{(pid=73029) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73029) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73029) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Checking secure boot support for host arch (x86_64) {{(pid=73029) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Checking secure boot support for host arch (x86_64) {{(pid=73029) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Checking secure boot support for host arch (x86_64) {{(pid=73029) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Checking secure boot support for host arch (x86_64) {{(pid=73029) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Checking secure boot support for host arch (x86_64) {{(pid=73029) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 10 00:31:13 user nova-compute[73029]: INFO nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Secure Boot support detected
Aug 10 00:31:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] cpu compare xml: <cpu match="exact">
Aug 10 00:31:13 user nova-compute[73029]:   <model>Nehalem</model>
Aug 10 00:31:13 user nova-compute[73029]: </cpu>
Aug 10 00:31:13 user nova-compute[73029]:  {{(pid=73029) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 10 00:31:13 user nova-compute[73029]: INFO nova.virt.node [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Generated node identity 78a3d833-6e7b-46db-90d0-fe7329a0c19a
Aug 10 00:31:13 user nova-compute[73029]: INFO nova.virt.node [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Wrote node identity 78a3d833-6e7b-46db-90d0-fe7329a0c19a to /opt/stack/data/nova/compute_id
Aug 10 00:31:13 user nova-compute[73029]: WARNING nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Compute nodes ['78a3d833-6e7b-46db-90d0-fe7329a0c19a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 10 00:31:14 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 10 00:31:14 user nova-compute[73029]: WARNING nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 10 00:31:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:31:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:31:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Hypervisor/Node resource view: name=user free_ram=10881MB free_disk=26.11498260498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:31:14 user nova-compute[73029]: WARNING nova.compute.resource_tracker [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] No compute node record for user:78a3d833-6e7b-46db-90d0-fe7329a0c19a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 78a3d833-6e7b-46db-90d0-fe7329a0c19a could not be found.
Aug 10 00:31:14 user nova-compute[73029]: INFO nova.compute.resource_tracker [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Compute node record created for user:user with uuid: 78a3d833-6e7b-46db-90d0-fe7329a0c19a
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:31:14 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [req-44ed5cc7-3b98-4bfb-b7cc-7e737bf45d7f] Created resource provider record via placement API for resource provider with UUID 78a3d833-6e7b-46db-90d0-fe7329a0c19a and name user.
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73029) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 10 00:31:14 user nova-compute[73029]: INFO nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] kernel doesn't support AMD SEV
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Libvirt baseline CPU <cpu>
Aug 10 00:31:14 user nova-compute[73029]:   <arch>x86_64</arch>
Aug 10 00:31:14 user nova-compute[73029]:   <model>Nehalem</model>
Aug 10 00:31:14 user nova-compute[73029]:   <vendor>Intel</vendor>
Aug 10 00:31:14 user nova-compute[73029]:   <topology sockets="6" cores="1" threads="1"/>
Aug 10 00:31:14 user nova-compute[73029]: </cpu>
Aug 10 00:31:14 user nova-compute[73029]:  {{(pid=73029) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Updated inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Updating resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a generation from 0 to 1 during operation: update_inventory {{(pid=73029) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 00:31:14 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Updating resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a generation from 1 to 2 during operation: update_traits {{(pid=73029) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 10 00:31:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:31:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:31:15 user nova-compute[73029]: DEBUG nova.service [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Creating RPC server for service compute {{(pid=73029) start /opt/stack/nova/nova/service.py:182}}
Aug 10 00:31:15 user nova-compute[73029]: DEBUG nova.service [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Join ServiceGroup membership for this service compute {{(pid=73029) start /opt/stack/nova/nova/service.py:199}}
Aug 10 00:31:15 user nova-compute[73029]: DEBUG nova.servicegroup.drivers.db [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73029) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 10 00:31:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:31:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:32:06 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:32:06 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=10246MB free_disk=26.018733978271484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:32:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:33:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:33:07 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:33:07 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=10219MB free_disk=26.063358306884766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:33:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.097s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:33:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:33:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:34:07 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:34:07 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=10206MB free_disk=25.837841033935547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:34:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:34:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:34:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:34:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:34:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:34:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:34:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:34:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:34:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:35:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:35:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 00:35:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 00:35:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:35:09 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:09 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:09 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=9446MB free_disk=25.860553741455078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:35:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:35:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:35:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:35:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:24 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:35:24 user nova-compute[73029]: INFO nova.compute.claims [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Claim successful on node user
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.082s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:35:25 user nova-compute[73029]: INFO nova.compute.claims [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Claim successful on node user
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:35:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:35:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Creating image(s)
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "/opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "/opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "/opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.network.neutron [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:35:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:35:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:35:26 user nova-compute[73029]: INFO nova.compute.claims [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Claim successful on node user
Aug 10 00:35:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:35:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Creating image(s)
Aug 10 00:35:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG nova.policy [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '675a2c106bab4b4d844a1dc6695c6b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74ba6ca527d41eca4d817804f405d23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf.part --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG nova.virt.images [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] 48fbc2bc-b0d2-49bf-97dd-ed057d979427 was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf.part /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:35:26 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG nova.policy [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '066b8c956dd146209ae7ecabfbf083ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60aabdbd31b647d68db993c0a60a43ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf.part /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf.converted" returned: 0 in 0.276s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.013s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:35:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.463s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:27 user nova-compute[73029]: INFO oslo.privsep.daemon [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpv_uuoquj/privsep.sock']
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.098s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:35:27 user sudo[82182]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpv_uuoquj/privsep.sock
Aug 10 00:35:27 user sudo[82182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 10 00:35:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:35:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Creating image(s)
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:27 user nova-compute[73029]: DEBUG nova.policy [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b7a69e6bcbf4ce3a0867b4f51564377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475e002776ae4e2e994cc801872bcfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:35:28 user sudo[82182]: pam_unix(sudo:session): session closed for user root
Aug 10 00:35:28 user nova-compute[73029]: INFO oslo.privsep.daemon [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Spawned new privsep daemon via rootwrap
Aug 10 00:35:28 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 10 00:35:28 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 10 00:35:28 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 10 00:35:28 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82185
Aug 10 00:35:28 user nova-compute[73029]: WARNING oslo_privsep.priv_context [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] privsep daemon already running
Aug 10 00:35:28 user nova-compute[73029]: WARNING oslo_privsep.priv_context [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] privsep daemon already running
Aug 10 00:35:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:28 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:35:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.217s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.170s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.214s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:35:29 user nova-compute[73029]: INFO nova.compute.claims [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Claim successful on node user
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.124s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk 1073741824" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.279s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk 1073741824" returned: 0 in 0.049s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.515s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Cannot resize image /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'migration_context' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Ensure instance console log exists: /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk 1073741824" returned: 0 in 0.047s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Cannot resize image /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lazy-loading 'migration_context' on Instance uuid 0012ccc2-0fdf-4bdc-84c7-be4279032bdd {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Ensure instance console log exists: /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:35:30 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Creating image(s)
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "/opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "/opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Cannot resize image /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'migration_context' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Ensure instance console log exists: /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Successfully created port: c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.190s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Successfully created port: ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.policy [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad4b1f5525d54f399db688f2ff7f0752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ec174542da4ef6ac5751fb12c9f808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk 1073741824" returned: 0 in 0.050s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Successfully created port: 756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Cannot resize image /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'migration_context' on Instance uuid aa5be433-9c8a-4e52-b61d-15a84f188cc3 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Ensure instance console log exists: /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:32 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Successfully updated port: ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:35:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquired lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:32 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:35:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:35:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-e802fe10-17ca-4448-9363-2840fdc5de70 req-229a917c-ced9-4990-9e21-371ed36ba8e3 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-changed-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-e802fe10-17ca-4448-9363-2840fdc5de70 req-229a917c-ced9-4990-9e21-371ed36ba8e3 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Refreshing instance network info cache due to event network-changed-ce93d51f-3ef0-48a2-b705-1a2d12fcccac. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:35:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e802fe10-17ca-4448-9363-2840fdc5de70 req-229a917c-ced9-4990-9e21-371ed36ba8e3 service nova] Acquiring lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Successfully created port: fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating instance_info_cache with network_info: [{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Releasing lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Instance network_info: |[{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e802fe10-17ca-4448-9363-2840fdc5de70 req-229a917c-ced9-4990-9e21-371ed36ba8e3 service nova] Acquired lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-e802fe10-17ca-4448-9363-2840fdc5de70 req-229a917c-ced9-4990-9e21-371ed36ba8e3 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Refreshing network info cache for port ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Start _get_guest_xml network_info=[{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:35:34 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:34 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-691660506',display_name='tempest-ServerStableDeviceRescueTest-server-691660506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-691660506',id=3,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2qMclUiDDtfdBQQEFJIJT7zei+fvBSFEd1IVsKrxuITgVneSkV8lM0t15+OyE3mgphGmJcPu/oAK76jlQjN7i12XxfI3xmn+chXoTRAs6YW2/irdffyhbV6xNXZ7tXIA==',key_name='tempest-keypair-1474595581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='475e002776ae4e2e994cc801872bcfad',ramdisk_id='',reservation_id='r-42a5wi0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-757302542',owner_user_name='tempest-ServerStableDeviceRescueTest-757302542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7a69e6bcbf4ce3a0867b4f51564377',uuid=4a17123b-6ea8-450b-9ada-8c8278dcf739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Converting VIF {"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:10:a5,bridge_name='br-int',has_traffic_filtering=True,id=ce93d51f-3ef0-48a2-b705-1a2d12fcccac,network=Network(ada601a5-86a5-4382-b1e3-b53be3e6364f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce93d51f-3e') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:35:34 user nova-compute[73029]:   <uuid>4a17123b-6ea8-450b-9ada-8c8278dcf739</uuid>
Aug 10 00:35:34 user nova-compute[73029]:   <name>instance-00000003</name>
Aug 10 00:35:34 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:35:34 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:35:34 user nova-compute[73029]:   <metadata>
Aug 10 00:35:34 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:35:34 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:35:34 user nova-compute[73029]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-691660506</nova:name>
Aug 10 00:35:34 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:35:34</nova:creationTime>
Aug 10 00:35:34 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:35:34 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:35:34 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:35:34 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:35:34 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:35:34 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:35:34 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:35:34 user nova-compute[73029]:       <nova:owner>
Aug 10 00:35:34 user nova-compute[73029]:         <nova:user uuid="7b7a69e6bcbf4ce3a0867b4f51564377">tempest-ServerStableDeviceRescueTest-757302542-project-member</nova:user>
Aug 10 00:35:34 user nova-compute[73029]:         <nova:project uuid="475e002776ae4e2e994cc801872bcfad">tempest-ServerStableDeviceRescueTest-757302542</nova:project>
Aug 10 00:35:34 user nova-compute[73029]:       </nova:owner>
Aug 10 00:35:34 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:35:34 user nova-compute[73029]:       <nova:ports>
Aug 10 00:35:34 user nova-compute[73029]:         <nova:port uuid="ce93d51f-3ef0-48a2-b705-1a2d12fcccac">
Aug 10 00:35:34 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 10 00:35:34 user nova-compute[73029]:         </nova:port>
Aug 10 00:35:34 user nova-compute[73029]:       </nova:ports>
Aug 10 00:35:34 user nova-compute[73029]:     </nova:instance>
Aug 10 00:35:34 user nova-compute[73029]:   </metadata>
Aug 10 00:35:34 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:35:34 user nova-compute[73029]:     <system>
Aug 10 00:35:34 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:35:34 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:35:34 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:35:34 user nova-compute[73029]:       <entry name="serial">4a17123b-6ea8-450b-9ada-8c8278dcf739</entry>
Aug 10 00:35:34 user nova-compute[73029]:       <entry name="uuid">4a17123b-6ea8-450b-9ada-8c8278dcf739</entry>
Aug 10 00:35:34 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:35:34 user nova-compute[73029]:     </system>
Aug 10 00:35:34 user nova-compute[73029]:   </sysinfo>
Aug 10 00:35:34 user nova-compute[73029]:   <os>
Aug 10 00:35:34 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:35:34 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:35:34 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:35:34 user nova-compute[73029]:   </os>
Aug 10 00:35:34 user nova-compute[73029]:   <features>
Aug 10 00:35:34 user nova-compute[73029]:     <acpi/>
Aug 10 00:35:34 user nova-compute[73029]:     <apic/>
Aug 10 00:35:34 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:35:34 user nova-compute[73029]:   </features>
Aug 10 00:35:34 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:35:34 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:35:34 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:35:34 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:35:34 user nova-compute[73029]:   </clock>
Aug 10 00:35:34 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:35:34 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:35:34 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:35:34 user nova-compute[73029]:   </cpu>
Aug 10 00:35:34 user nova-compute[73029]:   <devices>
Aug 10 00:35:34 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:35:34 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:35:34 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk"/>
Aug 10 00:35:34 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:35:34 user nova-compute[73029]:     </disk>
Aug 10 00:35:34 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:35:34 user nova-compute[73029]:       <mac address="fa:16:3e:bb:10:a5"/>
Aug 10 00:35:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:34 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:35:34 user nova-compute[73029]:       <target dev="tapce93d51f-3e"/>
Aug 10 00:35:34 user nova-compute[73029]:     </interface>
Aug 10 00:35:34 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:35:34 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/console.log" append="off"/>
Aug 10 00:35:34 user nova-compute[73029]:     </serial>
Aug 10 00:35:34 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:35:34 user nova-compute[73029]:     <video>
Aug 10 00:35:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:34 user nova-compute[73029]:     </video>
Aug 10 00:35:34 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:35:34 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:35:34 user nova-compute[73029]:     </rng>
Aug 10 00:35:34 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:35:34 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:35:34 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:35:34 user nova-compute[73029]:     </memballoon>
Aug 10 00:35:34 user nova-compute[73029]:   </devices>
Aug 10 00:35:34 user nova-compute[73029]: </domain>
Aug 10 00:35:34 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-691660506',display_name='tempest-ServerStableDeviceRescueTest-server-691660506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-691660506',id=3,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2qMclUiDDtfdBQQEFJIJT7zei+fvBSFEd1IVsKrxuITgVneSkV8lM0t15+OyE3mgphGmJcPu/oAK76jlQjN7i12XxfI3xmn+chXoTRAs6YW2/irdffyhbV6xNXZ7tXIA==',key_name='tempest-keypair-1474595581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='475e002776ae4e2e994cc801872bcfad',ramdisk_id='',reservation_id='r-42a5wi0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-757302542',owner_user_name='tempest-ServerStableDeviceRescueTest-757302542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7a69e6bcbf4ce3a0867b4f51564377',uuid=4a17123b-6ea8-450b-9ada-8c8278dcf739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Converting VIF {"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:10:a5,bridge_name='br-int',has_traffic_filtering=True,id=ce93d51f-3ef0-48a2-b705-1a2d12fcccac,network=Network(ada601a5-86a5-4382-b1e3-b53be3e6364f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce93d51f-3e') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG os_vif [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:10:a5,bridge_name='br-int',has_traffic_filtering=True,id=ce93d51f-3ef0-48a2-b705-1a2d12fcccac,network=Network(ada601a5-86a5-4382-b1e3-b53be3e6364f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce93d51f-3e') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Created schema index Interface.name {{(pid=73029) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Created schema index Port.name {{(pid=73029) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Created schema index Bridge.name {{(pid=73029) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [POLLOUT] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:35:34 user nova-compute[73029]: INFO oslo.privsep.daemon [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_w5y8623/privsep.sock']
Aug 10 00:35:34 user sudo[82333]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_w5y8623/privsep.sock
Aug 10 00:35:34 user sudo[82333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Successfully updated port: c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "refresh_cache-0012ccc2-0fdf-4bdc-84c7-be4279032bdd" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquired lock "refresh_cache-0012ccc2-0fdf-4bdc-84c7-be4279032bdd" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Successfully updated port: 756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquired lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:35:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d9f6a59-7e06-49b4-a1fc-d2c76f55b5ac req-c96ef81b-5d45-4f16-bf9b-bcef3b6bfff4 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received event network-changed-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d9f6a59-7e06-49b4-a1fc-d2c76f55b5ac req-c96ef81b-5d45-4f16-bf9b-bcef3b6bfff4 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Refreshing instance network info cache due to event network-changed-c1c23b28-3de6-48e2-b8ab-8ba102f025cb. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:35:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d9f6a59-7e06-49b4-a1fc-d2c76f55b5ac req-c96ef81b-5d45-4f16-bf9b-bcef3b6bfff4 service nova] Acquiring lock "refresh_cache-0012ccc2-0fdf-4bdc-84c7-be4279032bdd" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:35 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:35:35 user nova-compute[73029]: DEBUG nova.network.neutron [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:35:35 user nova-compute[73029]: DEBUG nova.network.neutron [req-e802fe10-17ca-4448-9363-2840fdc5de70 req-229a917c-ced9-4990-9e21-371ed36ba8e3 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updated VIF entry in instance network info cache for port ce93d51f-3ef0-48a2-b705-1a2d12fcccac. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:35:35 user nova-compute[73029]: DEBUG nova.network.neutron [req-e802fe10-17ca-4448-9363-2840fdc5de70 req-229a917c-ced9-4990-9e21-371ed36ba8e3 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating instance_info_cache with network_info: [{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e802fe10-17ca-4448-9363-2840fdc5de70 req-229a917c-ced9-4990-9e21-371ed36ba8e3 service nova] Releasing lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:36 user sudo[82333]: pam_unix(sudo:session): session closed for user root
Aug 10 00:35:36 user nova-compute[73029]: INFO oslo.privsep.daemon [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Spawned new privsep daemon via rootwrap
Aug 10 00:35:36 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 10 00:35:36 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 10 00:35:36 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 10 00:35:36 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82346
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating instance_info_cache with network_info: [{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Updating instance_info_cache with network_info: [{"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Releasing lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Instance network_info: |[{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Start _get_guest_xml network_info=[{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:35:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Releasing lock "refresh_cache-0012ccc2-0fdf-4bdc-84c7-be4279032bdd" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Instance network_info: |[{"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d9f6a59-7e06-49b4-a1fc-d2c76f55b5ac req-c96ef81b-5d45-4f16-bf9b-bcef3b6bfff4 service nova] Acquired lock "refresh_cache-0012ccc2-0fdf-4bdc-84c7-be4279032bdd" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.neutron [req-1d9f6a59-7e06-49b4-a1fc-d2c76f55b5ac req-c96ef81b-5d45-4f16-bf9b-bcef3b6bfff4 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Refreshing network info cache for port c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Start _get_guest_xml network_info=[{"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2093299035',display_name='tempest-ServerActionsTestOtherA-server-2093299035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2093299035',id=2,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-1q6bgm1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=ee3b2f60-0756-4d77-97ac-11fa0c456c1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.objects.instance [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'pci_devices' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:35:36 user nova-compute[73029]:   <uuid>ee3b2f60-0756-4d77-97ac-11fa0c456c1f</uuid>
Aug 10 00:35:36 user nova-compute[73029]:   <name>instance-00000002</name>
Aug 10 00:35:36 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:35:36 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:35:36 user nova-compute[73029]:   <metadata>
Aug 10 00:35:36 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:35:36 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:name>tempest-ServerActionsTestOtherA-server-2093299035</nova:name>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:35:36</nova:creationTime>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:35:36 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:35:36 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:owner>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:user uuid="066b8c956dd146209ae7ecabfbf083ff">tempest-ServerActionsTestOtherA-916478349-project-member</nova:user>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:project uuid="60aabdbd31b647d68db993c0a60a43ec">tempest-ServerActionsTestOtherA-916478349</nova:project>
Aug 10 00:35:36 user nova-compute[73029]:       </nova:owner>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:ports>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:port uuid="756092b1-bc75-4163-a66c-ecaff9bcb39d">
Aug 10 00:35:36 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 00:35:36 user nova-compute[73029]:         </nova:port>
Aug 10 00:35:36 user nova-compute[73029]:       </nova:ports>
Aug 10 00:35:36 user nova-compute[73029]:     </nova:instance>
Aug 10 00:35:36 user nova-compute[73029]:   </metadata>
Aug 10 00:35:36 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:35:36 user nova-compute[73029]:     <system>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="serial">ee3b2f60-0756-4d77-97ac-11fa0c456c1f</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="uuid">ee3b2f60-0756-4d77-97ac-11fa0c456c1f</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:35:36 user nova-compute[73029]:     </system>
Aug 10 00:35:36 user nova-compute[73029]:   </sysinfo>
Aug 10 00:35:36 user nova-compute[73029]:   <os>
Aug 10 00:35:36 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:35:36 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:35:36 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:35:36 user nova-compute[73029]:   </os>
Aug 10 00:35:36 user nova-compute[73029]:   <features>
Aug 10 00:35:36 user nova-compute[73029]:     <acpi/>
Aug 10 00:35:36 user nova-compute[73029]:     <apic/>
Aug 10 00:35:36 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:35:36 user nova-compute[73029]:   </features>
Aug 10 00:35:36 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:35:36 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:35:36 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:35:36 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:35:36 user nova-compute[73029]:   </clock>
Aug 10 00:35:36 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:35:36 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:35:36 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:35:36 user nova-compute[73029]:   </cpu>
Aug 10 00:35:36 user nova-compute[73029]:   <devices>
Aug 10 00:35:36 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:35:36 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:35:36 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk"/>
Aug 10 00:35:36 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:35:36 user nova-compute[73029]:     </disk>
Aug 10 00:35:36 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:35:36 user nova-compute[73029]:       <mac address="fa:16:3e:16:10:6b"/>
Aug 10 00:35:36 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:36 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:35:36 user nova-compute[73029]:       <target dev="tap756092b1-bc"/>
Aug 10 00:35:36 user nova-compute[73029]:     </interface>
Aug 10 00:35:36 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:35:36 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/console.log" append="off"/>
Aug 10 00:35:36 user nova-compute[73029]:     </serial>
Aug 10 00:35:36 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:35:36 user nova-compute[73029]:     <video>
Aug 10 00:35:36 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:36 user nova-compute[73029]:     </video>
Aug 10 00:35:36 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:35:36 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:35:36 user nova-compute[73029]:     </rng>
Aug 10 00:35:36 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:35:36 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:35:36 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:35:36 user nova-compute[73029]:     </memballoon>
Aug 10 00:35:36 user nova-compute[73029]:   </devices>
Aug 10 00:35:36 user nova-compute[73029]: </domain>
Aug 10 00:35:36 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2093299035',display_name='tempest-ServerActionsTestOtherA-server-2093299035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2093299035',id=2,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-1q6bgm1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=ee3b2f60-0756-4d77-97ac-11fa0c456c1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG os_vif [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1732138413',display_name='tempest-DeleteServersTestJSON-server-1732138413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1732138413',id=1,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c74ba6ca527d41eca4d817804f405d23',ramdisk_id='',reservation_id='r-hm3h0a4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-602116791',owner_user_name='tempest-DeleteServersTestJSON-602116791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:26Z,user_data=None,user_id='675a2c106bab4b4d844a1dc6695c6b7e',uuid=0012ccc2-0fdf-4bdc-84c7-be4279032bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Converting VIF {"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=c1c23b28-3de6-48e2-b8ab-8ba102f025cb,network=Network(d6aa8cdd-983c-41e3-a946-69480ea2bd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c23b28-3d') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.objects.instance [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lazy-loading 'pci_devices' on Instance uuid 0012ccc2-0fdf-4bdc-84c7-be4279032bdd {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:35:36 user nova-compute[73029]:   <uuid>0012ccc2-0fdf-4bdc-84c7-be4279032bdd</uuid>
Aug 10 00:35:36 user nova-compute[73029]:   <name>instance-00000001</name>
Aug 10 00:35:36 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:35:36 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:35:36 user nova-compute[73029]:   <metadata>
Aug 10 00:35:36 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:35:36 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:name>tempest-DeleteServersTestJSON-server-1732138413</nova:name>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:35:36</nova:creationTime>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:35:36 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:35:36 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:owner>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:user uuid="675a2c106bab4b4d844a1dc6695c6b7e">tempest-DeleteServersTestJSON-602116791-project-member</nova:user>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:project uuid="c74ba6ca527d41eca4d817804f405d23">tempest-DeleteServersTestJSON-602116791</nova:project>
Aug 10 00:35:36 user nova-compute[73029]:       </nova:owner>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:35:36 user nova-compute[73029]:       <nova:ports>
Aug 10 00:35:36 user nova-compute[73029]:         <nova:port uuid="c1c23b28-3de6-48e2-b8ab-8ba102f025cb">
Aug 10 00:35:36 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 10 00:35:36 user nova-compute[73029]:         </nova:port>
Aug 10 00:35:36 user nova-compute[73029]:       </nova:ports>
Aug 10 00:35:36 user nova-compute[73029]:     </nova:instance>
Aug 10 00:35:36 user nova-compute[73029]:   </metadata>
Aug 10 00:35:36 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:35:36 user nova-compute[73029]:     <system>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="serial">0012ccc2-0fdf-4bdc-84c7-be4279032bdd</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="uuid">0012ccc2-0fdf-4bdc-84c7-be4279032bdd</entry>
Aug 10 00:35:36 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:35:36 user nova-compute[73029]:     </system>
Aug 10 00:35:36 user nova-compute[73029]:   </sysinfo>
Aug 10 00:35:36 user nova-compute[73029]:   <os>
Aug 10 00:35:36 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:35:36 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:35:36 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:35:36 user nova-compute[73029]:   </os>
Aug 10 00:35:36 user nova-compute[73029]:   <features>
Aug 10 00:35:36 user nova-compute[73029]:     <acpi/>
Aug 10 00:35:36 user nova-compute[73029]:     <apic/>
Aug 10 00:35:36 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:35:36 user nova-compute[73029]:   </features>
Aug 10 00:35:36 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:35:36 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:35:36 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:35:36 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:35:36 user nova-compute[73029]:   </clock>
Aug 10 00:35:36 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:35:36 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:35:36 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:35:36 user nova-compute[73029]:   </cpu>
Aug 10 00:35:36 user nova-compute[73029]:   <devices>
Aug 10 00:35:36 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:35:36 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:35:36 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk"/>
Aug 10 00:35:36 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:35:36 user nova-compute[73029]:     </disk>
Aug 10 00:35:36 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:35:36 user nova-compute[73029]:       <mac address="fa:16:3e:40:66:5e"/>
Aug 10 00:35:36 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:36 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:35:36 user nova-compute[73029]:       <target dev="tapc1c23b28-3d"/>
Aug 10 00:35:36 user nova-compute[73029]:     </interface>
Aug 10 00:35:36 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:35:36 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/console.log" append="off"/>
Aug 10 00:35:36 user nova-compute[73029]:     </serial>
Aug 10 00:35:36 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:35:36 user nova-compute[73029]:     <video>
Aug 10 00:35:36 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:36 user nova-compute[73029]:     </video>
Aug 10 00:35:36 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:35:36 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:35:36 user nova-compute[73029]:     </rng>
Aug 10 00:35:36 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:35:36 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:35:36 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:35:36 user nova-compute[73029]:     </memballoon>
Aug 10 00:35:36 user nova-compute[73029]:   </devices>
Aug 10 00:35:36 user nova-compute[73029]: </domain>
Aug 10 00:35:36 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1732138413',display_name='tempest-DeleteServersTestJSON-server-1732138413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1732138413',id=1,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c74ba6ca527d41eca4d817804f405d23',ramdisk_id='',reservation_id='r-hm3h0a4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-602116791',owner_user_name='tempest-DeleteServersTestJSON-602116791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:26Z,user_data=None,user_id='675a2c106bab4b4d844a1dc6695c6b7e',uuid=0012ccc2-0fdf-4bdc-84c7-be4279032bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Converting VIF {"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=c1c23b28-3de6-48e2-b8ab-8ba102f025cb,network=Network(d6aa8cdd-983c-41e3-a946-69480ea2bd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c23b28-3d') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG os_vif [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=c1c23b28-3de6-48e2-b8ab-8ba102f025cb,network=Network(d6aa8cdd-983c-41e3-a946-69480ea2bd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c23b28-3d') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce93d51f-3e, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce93d51f-3e, col_values=(('external_ids', {'iface-id': 'ce93d51f-3ef0-48a2-b705-1a2d12fcccac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:10:a5', 'vm-uuid': '4a17123b-6ea8-450b-9ada-8c8278dcf739'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:37 user nova-compute[73029]: INFO os_vif [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:10:a5,bridge_name='br-int',has_traffic_filtering=True,id=ce93d51f-3ef0-48a2-b705-1a2d12fcccac,network=Network(ada601a5-86a5-4382-b1e3-b53be3e6364f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce93d51f-3e')
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1c23b28-3d, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1c23b28-3d, col_values=(('external_ids', {'iface-id': 'c1c23b28-3de6-48e2-b8ab-8ba102f025cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:66:5e', 'vm-uuid': '0012ccc2-0fdf-4bdc-84c7-be4279032bdd'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:37 user nova-compute[73029]: INFO os_vif [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=c1c23b28-3de6-48e2-b8ab-8ba102f025cb,network=Network(d6aa8cdd-983c-41e3-a946-69480ea2bd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c23b28-3d')
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap756092b1-bc, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap756092b1-bc, col_values=(('external_ids', {'iface-id': '756092b1-bc75-4163-a66c-ecaff9bcb39d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:10:6b', 'vm-uuid': 'ee3b2f60-0756-4d77-97ac-11fa0c456c1f'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:37 user nova-compute[73029]: INFO os_vif [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc')
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] No VIF found with MAC fa:16:3e:bb:10:a5, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] No VIF found with MAC fa:16:3e:40:66:5e, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No VIF found with MAC fa:16:3e:16:10:6b, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-005c2503-78e3-4c9e-924f-0ea8a0ca144c req-7f82c595-e087-43b6-84b8-8ad0f191cbff service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-changed-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-005c2503-78e3-4c9e-924f-0ea8a0ca144c req-7f82c595-e087-43b6-84b8-8ad0f191cbff service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Refreshing instance network info cache due to event network-changed-756092b1-bc75-4163-a66c-ecaff9bcb39d. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-005c2503-78e3-4c9e-924f-0ea8a0ca144c req-7f82c595-e087-43b6-84b8-8ad0f191cbff service nova] Acquiring lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-005c2503-78e3-4c9e-924f-0ea8a0ca144c req-7f82c595-e087-43b6-84b8-8ad0f191cbff service nova] Acquired lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.network.neutron [req-005c2503-78e3-4c9e-924f-0ea8a0ca144c req-7f82c595-e087-43b6-84b8-8ad0f191cbff service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Refreshing network info cache for port 756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Successfully updated port: fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquired lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:35:38 user nova-compute[73029]: DEBUG nova.network.neutron [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:35:38 user nova-compute[73029]: DEBUG nova.network.neutron [req-1d9f6a59-7e06-49b4-a1fc-d2c76f55b5ac req-c96ef81b-5d45-4f16-bf9b-bcef3b6bfff4 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Updated VIF entry in instance network info cache for port c1c23b28-3de6-48e2-b8ab-8ba102f025cb. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:35:38 user nova-compute[73029]: DEBUG nova.network.neutron [req-1d9f6a59-7e06-49b4-a1fc-d2c76f55b5ac req-c96ef81b-5d45-4f16-bf9b-bcef3b6bfff4 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Updating instance_info_cache with network_info: [{"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d9f6a59-7e06-49b4-a1fc-d2c76f55b5ac req-c96ef81b-5d45-4f16-bf9b-bcef3b6bfff4 service nova] Releasing lock "refresh_cache-0012ccc2-0fdf-4bdc-84c7-be4279032bdd" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.network.neutron [req-005c2503-78e3-4c9e-924f-0ea8a0ca144c req-7f82c595-e087-43b6-84b8-8ad0f191cbff service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updated VIF entry in instance network info cache for port 756092b1-bc75-4163-a66c-ecaff9bcb39d. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.network.neutron [req-005c2503-78e3-4c9e-924f-0ea8a0ca144c req-7f82c595-e087-43b6-84b8-8ad0f191cbff service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating instance_info_cache with network_info: [{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-005c2503-78e3-4c9e-924f-0ea8a0ca144c req-7f82c595-e087-43b6-84b8-8ad0f191cbff service nova] Releasing lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.network.neutron [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Updating instance_info_cache with network_info: [{"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Releasing lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Instance network_info: |[{"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Start _get_guest_xml network_info=[{"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:35:39 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:39 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247021724',display_name='tempest-AttachVolumeNegativeTest-server-1247021724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247021724',id=4,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbBLDKbApinGC6hgdl3zET+Qq1wfPABVRqzeZYVhFC6RsKoiCsbNGrzctbFgafQPrTWh0Hi7qBkTjwiP9Sq/ZIsb8NerlLBLz9aX7q77BYjFk/Qz+F5wsiWkczdnywdgQ==',key_name='tempest-keypair-206874666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-3opc60ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=aa5be433-9c8a-4e52-b61d-15a84f188cc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9b:d7,bridge_name='br-int',has_traffic_filtering=True,id=fdf2d6d9-ffa0-4264-9bef-d602571f44e4,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf2d6d9-ff') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'pci_devices' on Instance uuid aa5be433-9c8a-4e52-b61d-15a84f188cc3 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:35:39 user nova-compute[73029]:   <uuid>aa5be433-9c8a-4e52-b61d-15a84f188cc3</uuid>
Aug 10 00:35:39 user nova-compute[73029]:   <name>instance-00000004</name>
Aug 10 00:35:39 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:35:39 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:35:39 user nova-compute[73029]:   <metadata>
Aug 10 00:35:39 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:35:39 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:35:39 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1247021724</nova:name>
Aug 10 00:35:39 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:35:39</nova:creationTime>
Aug 10 00:35:39 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:35:39 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:35:39 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:35:39 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:35:39 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:35:39 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:35:39 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:35:39 user nova-compute[73029]:       <nova:owner>
Aug 10 00:35:39 user nova-compute[73029]:         <nova:user uuid="ad4b1f5525d54f399db688f2ff7f0752">tempest-AttachVolumeNegativeTest-685145765-project-member</nova:user>
Aug 10 00:35:39 user nova-compute[73029]:         <nova:project uuid="22ec174542da4ef6ac5751fb12c9f808">tempest-AttachVolumeNegativeTest-685145765</nova:project>
Aug 10 00:35:39 user nova-compute[73029]:       </nova:owner>
Aug 10 00:35:39 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:35:39 user nova-compute[73029]:       <nova:ports>
Aug 10 00:35:39 user nova-compute[73029]:         <nova:port uuid="fdf2d6d9-ffa0-4264-9bef-d602571f44e4">
Aug 10 00:35:39 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 10 00:35:39 user nova-compute[73029]:         </nova:port>
Aug 10 00:35:39 user nova-compute[73029]:       </nova:ports>
Aug 10 00:35:39 user nova-compute[73029]:     </nova:instance>
Aug 10 00:35:39 user nova-compute[73029]:   </metadata>
Aug 10 00:35:39 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:35:39 user nova-compute[73029]:     <system>
Aug 10 00:35:39 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:35:39 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:35:39 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:35:39 user nova-compute[73029]:       <entry name="serial">aa5be433-9c8a-4e52-b61d-15a84f188cc3</entry>
Aug 10 00:35:39 user nova-compute[73029]:       <entry name="uuid">aa5be433-9c8a-4e52-b61d-15a84f188cc3</entry>
Aug 10 00:35:39 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:35:39 user nova-compute[73029]:     </system>
Aug 10 00:35:39 user nova-compute[73029]:   </sysinfo>
Aug 10 00:35:39 user nova-compute[73029]:   <os>
Aug 10 00:35:39 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:35:39 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:35:39 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:35:39 user nova-compute[73029]:   </os>
Aug 10 00:35:39 user nova-compute[73029]:   <features>
Aug 10 00:35:39 user nova-compute[73029]:     <acpi/>
Aug 10 00:35:39 user nova-compute[73029]:     <apic/>
Aug 10 00:35:39 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:35:39 user nova-compute[73029]:   </features>
Aug 10 00:35:39 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:35:39 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:35:39 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:35:39 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:35:39 user nova-compute[73029]:   </clock>
Aug 10 00:35:39 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:35:39 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:35:39 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:35:39 user nova-compute[73029]:   </cpu>
Aug 10 00:35:39 user nova-compute[73029]:   <devices>
Aug 10 00:35:39 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:35:39 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:35:39 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk"/>
Aug 10 00:35:39 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:35:39 user nova-compute[73029]:     </disk>
Aug 10 00:35:39 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:35:39 user nova-compute[73029]:       <mac address="fa:16:3e:a1:9b:d7"/>
Aug 10 00:35:39 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:39 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:35:39 user nova-compute[73029]:       <target dev="tapfdf2d6d9-ff"/>
Aug 10 00:35:39 user nova-compute[73029]:     </interface>
Aug 10 00:35:39 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:35:39 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/console.log" append="off"/>
Aug 10 00:35:39 user nova-compute[73029]:     </serial>
Aug 10 00:35:39 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:35:39 user nova-compute[73029]:     <video>
Aug 10 00:35:39 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:39 user nova-compute[73029]:     </video>
Aug 10 00:35:39 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:35:39 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:35:39 user nova-compute[73029]:     </rng>
Aug 10 00:35:39 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:35:39 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:35:39 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:35:39 user nova-compute[73029]:     </memballoon>
Aug 10 00:35:39 user nova-compute[73029]:   </devices>
Aug 10 00:35:39 user nova-compute[73029]: </domain>
Aug 10 00:35:39 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247021724',display_name='tempest-AttachVolumeNegativeTest-server-1247021724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247021724',id=4,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbBLDKbApinGC6hgdl3zET+Qq1wfPABVRqzeZYVhFC6RsKoiCsbNGrzctbFgafQPrTWh0Hi7qBkTjwiP9Sq/ZIsb8NerlLBLz9aX7q77BYjFk/Qz+F5wsiWkczdnywdgQ==',key_name='tempest-keypair-206874666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-3opc60ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=aa5be433-9c8a-4e52-b61d-15a84f188cc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9b:d7,bridge_name='br-int',has_traffic_filtering=True,id=fdf2d6d9-ffa0-4264-9bef-d602571f44e4,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf2d6d9-ff') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG os_vif [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9b:d7,bridge_name='br-int',has_traffic_filtering=True,id=fdf2d6d9-ffa0-4264-9bef-d602571f44e4,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf2d6d9-ff') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdf2d6d9-ff, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdf2d6d9-ff, col_values=(('external_ids', {'iface-id': 'fdf2d6d9-ffa0-4264-9bef-d602571f44e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:9b:d7', 'vm-uuid': 'aa5be433-9c8a-4e52-b61d-15a84f188cc3'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:39 user nova-compute[73029]: INFO os_vif [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:9b:d7,bridge_name='br-int',has_traffic_filtering=True,id=fdf2d6d9-ffa0-4264-9bef-d602571f44e4,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf2d6d9-ff')
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-29cbeca6-8a2d-429b-b747-506253f11db7 req-6f2a0cdf-76fd-4cde-b459-588298a9949e service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received event network-changed-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-29cbeca6-8a2d-429b-b747-506253f11db7 req-6f2a0cdf-76fd-4cde-b459-588298a9949e service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Refreshing instance network info cache due to event network-changed-fdf2d6d9-ffa0-4264-9bef-d602571f44e4. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-29cbeca6-8a2d-429b-b747-506253f11db7 req-6f2a0cdf-76fd-4cde-b459-588298a9949e service nova] Acquiring lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-29cbeca6-8a2d-429b-b747-506253f11db7 req-6f2a0cdf-76fd-4cde-b459-588298a9949e service nova] Acquired lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.network.neutron [req-29cbeca6-8a2d-429b-b747-506253f11db7 req-6f2a0cdf-76fd-4cde-b459-588298a9949e service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Refreshing network info cache for port fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:35:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No VIF found with MAC fa:16:3e:a1:9b:d7, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:35:40 user nova-compute[73029]: INFO nova.compute.claims [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Claim successful on node user
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:35:40 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:35:40 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Creating image(s)
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "/opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "/opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.129s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.122s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk 1073741824" returned: 0 in 0.050s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG nova.network.neutron [req-29cbeca6-8a2d-429b-b747-506253f11db7 req-6f2a0cdf-76fd-4cde-b459-588298a9949e service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Updated VIF entry in instance network info cache for port fdf2d6d9-ffa0-4264-9bef-d602571f44e4. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG nova.network.neutron [req-29cbeca6-8a2d-429b-b747-506253f11db7 req-6f2a0cdf-76fd-4cde-b459-588298a9949e service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Updating instance_info_cache with network_info: [{"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.195s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-29cbeca6-8a2d-429b-b747-506253f11db7 req-6f2a0cdf-76fd-4cde-b459-588298a9949e service nova] Releasing lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Cannot resize image /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG nova.objects.instance [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lazy-loading 'migration_context' on Instance uuid e7d1898b-0b2e-4feb-9d06-48e20eb9e409 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG nova.policy [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f52da2ce49444c19eac225f85e7a157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cacd78e5db48399ddb0b666498b7af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Ensure instance console log exists: /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:35:42 user nova-compute[73029]: INFO nova.compute.claims [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Claim successful on node user
Aug 10 00:35:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:35:42 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-883743f7-5419-4328-869f-741e364d2658 req-b4315069-2fc0-40de-a0fa-9a9a7a7a9207 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-883743f7-5419-4328-869f-741e364d2658 req-b4315069-2fc0-40de-a0fa-9a9a7a7a9207 service nova] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-883743f7-5419-4328-869f-741e364d2658 req-b4315069-2fc0-40de-a0fa-9a9a7a7a9207 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-883743f7-5419-4328-869f-741e364d2658 req-b4315069-2fc0-40de-a0fa-9a9a7a7a9207 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-883743f7-5419-4328-869f-741e364d2658 req-b4315069-2fc0-40de-a0fa-9a9a7a7a9207 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] No waiting events found dispatching network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:43 user nova-compute[73029]: WARNING nova.compute.manager [req-883743f7-5419-4328-869f-741e364d2658 req-b4315069-2fc0-40de-a0fa-9a9a7a7a9207 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received unexpected event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d for instance with vm_state building and task_state spawning.
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:35:43 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:35:43 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Creating image(s)
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquiring lock "/opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "/opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "/opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.176s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.160s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk 1073741824" returned: 0 in 0.124s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.policy [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf978307cc87467ca8bcbf895a236acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba8a47ca61640859b942d60732adfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.216s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Cannot resize image /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lazy-loading 'migration_context' on Instance uuid 77e0dc6b-541f-4032-9f93-f0cc395b0a22 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Ensure instance console log exists: /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Successfully created port: 98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-3586abb6-30a7-42eb-aaf5-2789e2cfcbfa req-30329672-b01b-42d6-bc05-d2a7cf2de232 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3586abb6-30a7-42eb-aaf5-2789e2cfcbfa req-30329672-b01b-42d6-bc05-d2a7cf2de232 service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3586abb6-30a7-42eb-aaf5-2789e2cfcbfa req-30329672-b01b-42d6-bc05-d2a7cf2de232 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3586abb6-30a7-42eb-aaf5-2789e2cfcbfa req-30329672-b01b-42d6-bc05-d2a7cf2de232 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-3586abb6-30a7-42eb-aaf5-2789e2cfcbfa req-30329672-b01b-42d6-bc05-d2a7cf2de232 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:44 user nova-compute[73029]: WARNING nova.compute.manager [req-3586abb6-30a7-42eb-aaf5-2789e2cfcbfa req-30329672-b01b-42d6-bc05-d2a7cf2de232 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state building and task_state spawning.
Aug 10 00:35:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-c0deac87-79fd-4796-80ec-de1bd6524e72 req-2ed79ab7-b038-4c9e-96c2-6deb741ee79d service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c0deac87-79fd-4796-80ec-de1bd6524e72 req-2ed79ab7-b038-4c9e-96c2-6deb741ee79d service nova] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c0deac87-79fd-4796-80ec-de1bd6524e72 req-2ed79ab7-b038-4c9e-96c2-6deb741ee79d service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c0deac87-79fd-4796-80ec-de1bd6524e72 req-2ed79ab7-b038-4c9e-96c2-6deb741ee79d service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-c0deac87-79fd-4796-80ec-de1bd6524e72 req-2ed79ab7-b038-4c9e-96c2-6deb741ee79d service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] No waiting events found dispatching network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:45 user nova-compute[73029]: WARNING nova.compute.manager [req-c0deac87-79fd-4796-80ec-de1bd6524e72 req-2ed79ab7-b038-4c9e-96c2-6deb741ee79d service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received unexpected event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d for instance with vm_state building and task_state spawning.
Aug 10 00:35:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Successfully created port: fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627746.0076694, 4a17123b-6ea8-450b-9ada-8c8278dcf739 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] VM Resumed (Lifecycle Event)
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Instance spawned successfully.
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627746.008274, 4a17123b-6ea8-450b-9ada-8c8278dcf739 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] VM Started (Lifecycle Event)
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Took 18.80 seconds to spawn the instance on the hypervisor.
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Took 20.45 seconds to build instance.
Aug 10 00:35:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b9372b-2654-401c-8554-8544f40281e1 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.614s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627746.6073349, ee3b2f60-0756-4d77-97ac-11fa0c456c1f => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] VM Resumed (Lifecycle Event)
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Instance spawned successfully.
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627746.6105294, ee3b2f60-0756-4d77-97ac-11fa0c456c1f => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] VM Started (Lifecycle Event)
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Took 20.71 seconds to spawn the instance on the hypervisor.
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627746.8478482, aa5be433-9c8a-4e52-b61d-15a84f188cc3 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] VM Resumed (Lifecycle Event)
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:35:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Instance spawned successfully.
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:46 user nova-compute[73029]: WARNING nova.compute.manager [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state active and task_state None.
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received event network-vif-plugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] No waiting events found dispatching network-vif-plugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:46 user nova-compute[73029]: WARNING nova.compute.manager [req-e137536e-fa0f-4603-84fd-50d0cfcb9ec5 req-6a69ab51-fe2a-4f85-8831-b1626d3472de service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received unexpected event network-vif-plugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 for instance with vm_state building and task_state spawning.
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Instance spawned successfully.
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Took 21.90 seconds to build instance.
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627746.8514605, aa5be433-9c8a-4e52-b61d-15a84f188cc3 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] VM Started (Lifecycle Event)
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-84a9d319-310e-42ae-b957-be9f3a7bd050 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.061s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Took 17.02 seconds to spawn the instance on the hypervisor.
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Successfully updated port: 98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Took 21.50 seconds to spawn the instance on the hypervisor.
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquired lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627746.967894, 0012ccc2-0fdf-4bdc-84c7-be4279032bdd => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] VM Resumed (Lifecycle Event)
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627746.968379, 0012ccc2-0fdf-4bdc-84c7-be4279032bdd => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] VM Started (Lifecycle Event)
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Took 18.38 seconds to build instance.
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:47 user nova-compute[73029]: INFO nova.compute.manager [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Took 22.57 seconds to build instance.
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c88341f0-c064-489b-ad83-4b9382176ec9 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.636s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6839d11d-e91f-4d22-ab94-060226ff5242 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.806s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:47 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updating instance_info_cache with network_info: [{"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Releasing lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Instance network_info: |[{"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Start _get_guest_xml network_info=[{"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:35:48 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:48 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-580676524',display_name='tempest-VolumesAdminNegativeTest-server-580676524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-580676524',id=5,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdfpZynWc2SoMa3N4a4J9AI9cj4/d4XXJ7kInHnSYtEAImImHbLqEWNnEsXx4aJaUVHj9rTvZUW+Ocr/m59/UNfJgXqRfg/ElWs7ikwbXvNU3gbnnauym7PXHJzYUmnpg==',key_name='tempest-keypair-1869316900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65cacd78e5db48399ddb0b666498b7af',ramdisk_id='',reservation_id='r-t42o6h0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-592274289',owner_user_name='tempest-VolumesAdminNegativeTest-592274289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f52da2ce49444c19eac225f85e7a157',uuid=e7d1898b-0b2e-4feb-9d06-48e20eb9e409,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converting VIF {"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:90:57,bridge_name='br-int',has_traffic_filtering=True,id=98438a2e-6f9b-4fe4-b0b8-216dc9a794bb,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98438a2e-6f') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.objects.instance [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lazy-loading 'pci_devices' on Instance uuid e7d1898b-0b2e-4feb-9d06-48e20eb9e409 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:35:48 user nova-compute[73029]:   <uuid>e7d1898b-0b2e-4feb-9d06-48e20eb9e409</uuid>
Aug 10 00:35:48 user nova-compute[73029]:   <name>instance-00000005</name>
Aug 10 00:35:48 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:35:48 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:35:48 user nova-compute[73029]:   <metadata>
Aug 10 00:35:48 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:35:48 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:35:48 user nova-compute[73029]:       <nova:name>tempest-VolumesAdminNegativeTest-server-580676524</nova:name>
Aug 10 00:35:48 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:35:48</nova:creationTime>
Aug 10 00:35:48 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:35:48 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:35:48 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:35:48 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:35:48 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:35:48 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:35:48 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:35:48 user nova-compute[73029]:       <nova:owner>
Aug 10 00:35:48 user nova-compute[73029]:         <nova:user uuid="2f52da2ce49444c19eac225f85e7a157">tempest-VolumesAdminNegativeTest-592274289-project-member</nova:user>
Aug 10 00:35:48 user nova-compute[73029]:         <nova:project uuid="65cacd78e5db48399ddb0b666498b7af">tempest-VolumesAdminNegativeTest-592274289</nova:project>
Aug 10 00:35:48 user nova-compute[73029]:       </nova:owner>
Aug 10 00:35:48 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:35:48 user nova-compute[73029]:       <nova:ports>
Aug 10 00:35:48 user nova-compute[73029]:         <nova:port uuid="98438a2e-6f9b-4fe4-b0b8-216dc9a794bb">
Aug 10 00:35:48 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 00:35:48 user nova-compute[73029]:         </nova:port>
Aug 10 00:35:48 user nova-compute[73029]:       </nova:ports>
Aug 10 00:35:48 user nova-compute[73029]:     </nova:instance>
Aug 10 00:35:48 user nova-compute[73029]:   </metadata>
Aug 10 00:35:48 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:35:48 user nova-compute[73029]:     <system>
Aug 10 00:35:48 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:35:48 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:35:48 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:35:48 user nova-compute[73029]:       <entry name="serial">e7d1898b-0b2e-4feb-9d06-48e20eb9e409</entry>
Aug 10 00:35:48 user nova-compute[73029]:       <entry name="uuid">e7d1898b-0b2e-4feb-9d06-48e20eb9e409</entry>
Aug 10 00:35:48 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:35:48 user nova-compute[73029]:     </system>
Aug 10 00:35:48 user nova-compute[73029]:   </sysinfo>
Aug 10 00:35:48 user nova-compute[73029]:   <os>
Aug 10 00:35:48 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:35:48 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:35:48 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:35:48 user nova-compute[73029]:   </os>
Aug 10 00:35:48 user nova-compute[73029]:   <features>
Aug 10 00:35:48 user nova-compute[73029]:     <acpi/>
Aug 10 00:35:48 user nova-compute[73029]:     <apic/>
Aug 10 00:35:48 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:35:48 user nova-compute[73029]:   </features>
Aug 10 00:35:48 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:35:48 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:35:48 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:35:48 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:35:48 user nova-compute[73029]:   </clock>
Aug 10 00:35:48 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:35:48 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:35:48 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:35:48 user nova-compute[73029]:   </cpu>
Aug 10 00:35:48 user nova-compute[73029]:   <devices>
Aug 10 00:35:48 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:35:48 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:35:48 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk"/>
Aug 10 00:35:48 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:35:48 user nova-compute[73029]:     </disk>
Aug 10 00:35:48 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:35:48 user nova-compute[73029]:       <mac address="fa:16:3e:8c:90:57"/>
Aug 10 00:35:48 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:48 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:35:48 user nova-compute[73029]:       <target dev="tap98438a2e-6f"/>
Aug 10 00:35:48 user nova-compute[73029]:     </interface>
Aug 10 00:35:48 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:35:48 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/console.log" append="off"/>
Aug 10 00:35:48 user nova-compute[73029]:     </serial>
Aug 10 00:35:48 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:35:48 user nova-compute[73029]:     <video>
Aug 10 00:35:48 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:48 user nova-compute[73029]:     </video>
Aug 10 00:35:48 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:35:48 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:35:48 user nova-compute[73029]:     </rng>
Aug 10 00:35:48 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:35:48 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:35:48 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:35:48 user nova-compute[73029]:     </memballoon>
Aug 10 00:35:48 user nova-compute[73029]:   </devices>
Aug 10 00:35:48 user nova-compute[73029]: </domain>
Aug 10 00:35:48 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-580676524',display_name='tempest-VolumesAdminNegativeTest-server-580676524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-580676524',id=5,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdfpZynWc2SoMa3N4a4J9AI9cj4/d4XXJ7kInHnSYtEAImImHbLqEWNnEsXx4aJaUVHj9rTvZUW+Ocr/m59/UNfJgXqRfg/ElWs7ikwbXvNU3gbnnauym7PXHJzYUmnpg==',key_name='tempest-keypair-1869316900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65cacd78e5db48399ddb0b666498b7af',ramdisk_id='',reservation_id='r-t42o6h0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-592274289',owner_user_name='tempest-VolumesAdminNegativeTest-592274289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f52da2ce49444c19eac225f85e7a157',uuid=e7d1898b-0b2e-4feb-9d06-48e20eb9e409,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converting VIF {"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:90:57,bridge_name='br-int',has_traffic_filtering=True,id=98438a2e-6f9b-4fe4-b0b8-216dc9a794bb,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98438a2e-6f') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG os_vif [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:90:57,bridge_name='br-int',has_traffic_filtering=True,id=98438a2e-6f9b-4fe4-b0b8-216dc9a794bb,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98438a2e-6f') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98438a2e-6f, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98438a2e-6f, col_values=(('external_ids', {'iface-id': '98438a2e-6f9b-4fe4-b0b8-216dc9a794bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:90:57', 'vm-uuid': 'e7d1898b-0b2e-4feb-9d06-48e20eb9e409'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:35:48 user nova-compute[73029]: INFO os_vif [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:90:57,bridge_name='br-int',has_traffic_filtering=True,id=98438a2e-6f9b-4fe4-b0b8-216dc9a794bb,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98438a2e-6f')
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] No VIF found with MAC fa:16:3e:8c:90:57, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Successfully updated port: fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquiring lock "refresh_cache-77e0dc6b-541f-4032-9f93-f0cc395b0a22" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquired lock "refresh_cache-77e0dc6b-541f-4032-9f93-f0cc395b0a22" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received event network-vif-plugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] No waiting events found dispatching network-vif-plugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:49 user nova-compute[73029]: WARNING nova.compute.manager [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received unexpected event network-vif-plugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 for instance with vm_state active and task_state None.
Aug 10 00:35:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received event network-changed-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Refreshing instance network info cache due to event network-changed-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] Acquiring lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] Acquired lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG nova.network.neutron [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Refreshing network info cache for port 98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Updating instance_info_cache with network_info: [{"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Releasing lock "refresh_cache-77e0dc6b-541f-4032-9f93-f0cc395b0a22" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Instance network_info: |[{"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Start _get_guest_xml network_info=[{"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:35:50 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:50 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-282335105',display_name='tempest-VolumesAssistedSnapshotsTest-server-282335105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-282335105',id=6,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPveiMJZkK2uODP1nxNdjTxYfCOo5NOazSmIz56i5X28loUOAup74lwjwRXBbn+OAE/kggMC12unw1EhhPut3gzdjnGbDvHB/OCqeUWDIj105PJfUnxHRGNPLTD7ILhVQ==',key_name='tempest-keypair-1623386701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba8a47ca61640859b942d60732adfb3',ramdisk_id='',reservation_id='r-hpamexyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-592322439',owner_user_name='tempest-VolumesAssistedSnapshotsTest-592322439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf978307cc87467ca8bcbf895a236acf',uuid=77e0dc6b-541f-4032-9f93-f0cc395b0a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Converting VIF {"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:15:c8,bridge_name='br-int',has_traffic_filtering=True,id=fec11eed-17da-425c-89be-003dfd7f60c6,network=Network(c83f9c82-c79c-4752-af66-70866e7e82b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec11eed-17') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lazy-loading 'pci_devices' on Instance uuid 77e0dc6b-541f-4032-9f93-f0cc395b0a22 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:35:50 user nova-compute[73029]:   <uuid>77e0dc6b-541f-4032-9f93-f0cc395b0a22</uuid>
Aug 10 00:35:50 user nova-compute[73029]:   <name>instance-00000006</name>
Aug 10 00:35:50 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:35:50 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:35:50 user nova-compute[73029]:   <metadata>
Aug 10 00:35:50 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:35:50 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:35:50 user nova-compute[73029]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-282335105</nova:name>
Aug 10 00:35:50 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:35:50</nova:creationTime>
Aug 10 00:35:50 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:35:50 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:35:50 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:35:50 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:35:50 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:35:50 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:35:50 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:35:50 user nova-compute[73029]:       <nova:owner>
Aug 10 00:35:50 user nova-compute[73029]:         <nova:user uuid="bf978307cc87467ca8bcbf895a236acf">tempest-VolumesAssistedSnapshotsTest-592322439-project-member</nova:user>
Aug 10 00:35:50 user nova-compute[73029]:         <nova:project uuid="0ba8a47ca61640859b942d60732adfb3">tempest-VolumesAssistedSnapshotsTest-592322439</nova:project>
Aug 10 00:35:50 user nova-compute[73029]:       </nova:owner>
Aug 10 00:35:50 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:35:50 user nova-compute[73029]:       <nova:ports>
Aug 10 00:35:50 user nova-compute[73029]:         <nova:port uuid="fec11eed-17da-425c-89be-003dfd7f60c6">
Aug 10 00:35:50 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 00:35:50 user nova-compute[73029]:         </nova:port>
Aug 10 00:35:50 user nova-compute[73029]:       </nova:ports>
Aug 10 00:35:50 user nova-compute[73029]:     </nova:instance>
Aug 10 00:35:50 user nova-compute[73029]:   </metadata>
Aug 10 00:35:50 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:35:50 user nova-compute[73029]:     <system>
Aug 10 00:35:50 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:35:50 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:35:50 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:35:50 user nova-compute[73029]:       <entry name="serial">77e0dc6b-541f-4032-9f93-f0cc395b0a22</entry>
Aug 10 00:35:50 user nova-compute[73029]:       <entry name="uuid">77e0dc6b-541f-4032-9f93-f0cc395b0a22</entry>
Aug 10 00:35:50 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:35:50 user nova-compute[73029]:     </system>
Aug 10 00:35:50 user nova-compute[73029]:   </sysinfo>
Aug 10 00:35:50 user nova-compute[73029]:   <os>
Aug 10 00:35:50 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:35:50 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:35:50 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:35:50 user nova-compute[73029]:   </os>
Aug 10 00:35:50 user nova-compute[73029]:   <features>
Aug 10 00:35:50 user nova-compute[73029]:     <acpi/>
Aug 10 00:35:50 user nova-compute[73029]:     <apic/>
Aug 10 00:35:50 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:35:50 user nova-compute[73029]:   </features>
Aug 10 00:35:50 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:35:50 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:35:50 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:35:50 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:35:50 user nova-compute[73029]:   </clock>
Aug 10 00:35:50 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:35:50 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:35:50 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:35:50 user nova-compute[73029]:   </cpu>
Aug 10 00:35:50 user nova-compute[73029]:   <devices>
Aug 10 00:35:50 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:35:50 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:35:50 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk"/>
Aug 10 00:35:50 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:35:50 user nova-compute[73029]:     </disk>
Aug 10 00:35:50 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:35:50 user nova-compute[73029]:       <mac address="fa:16:3e:a9:15:c8"/>
Aug 10 00:35:50 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:50 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:35:50 user nova-compute[73029]:       <target dev="tapfec11eed-17"/>
Aug 10 00:35:50 user nova-compute[73029]:     </interface>
Aug 10 00:35:50 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:35:50 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/console.log" append="off"/>
Aug 10 00:35:50 user nova-compute[73029]:     </serial>
Aug 10 00:35:50 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:35:50 user nova-compute[73029]:     <video>
Aug 10 00:35:50 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:50 user nova-compute[73029]:     </video>
Aug 10 00:35:50 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:35:50 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:35:50 user nova-compute[73029]:     </rng>
Aug 10 00:35:50 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:35:50 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:35:50 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:35:50 user nova-compute[73029]:     </memballoon>
Aug 10 00:35:50 user nova-compute[73029]:   </devices>
Aug 10 00:35:50 user nova-compute[73029]: </domain>
Aug 10 00:35:50 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-282335105',display_name='tempest-VolumesAssistedSnapshotsTest-server-282335105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-282335105',id=6,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPveiMJZkK2uODP1nxNdjTxYfCOo5NOazSmIz56i5X28loUOAup74lwjwRXBbn+OAE/kggMC12unw1EhhPut3gzdjnGbDvHB/OCqeUWDIj105PJfUnxHRGNPLTD7ILhVQ==',key_name='tempest-keypair-1623386701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba8a47ca61640859b942d60732adfb3',ramdisk_id='',reservation_id='r-hpamexyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-592322439',owner_user_name='tempest-VolumesAssistedSnapshotsTest-592322439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf978307cc87467ca8bcbf895a236acf',uuid=77e0dc6b-541f-4032-9f93-f0cc395b0a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Converting VIF {"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:15:c8,bridge_name='br-int',has_traffic_filtering=True,id=fec11eed-17da-425c-89be-003dfd7f60c6,network=Network(c83f9c82-c79c-4752-af66-70866e7e82b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec11eed-17') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG os_vif [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:15:c8,bridge_name='br-int',has_traffic_filtering=True,id=fec11eed-17da-425c-89be-003dfd7f60c6,network=Network(c83f9c82-c79c-4752-af66-70866e7e82b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec11eed-17') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfec11eed-17, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfec11eed-17, col_values=(('external_ids', {'iface-id': 'fec11eed-17da-425c-89be-003dfd7f60c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:15:c8', 'vm-uuid': '77e0dc6b-541f-4032-9f93-f0cc395b0a22'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:50 user nova-compute[73029]: INFO os_vif [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:15:c8,bridge_name='br-int',has_traffic_filtering=True,id=fec11eed-17da-425c-89be-003dfd7f60c6,network=Network(c83f9c82-c79c-4752-af66-70866e7e82b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec11eed-17')
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.network.neutron [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updated VIF entry in instance network info cache for port 98438a2e-6f9b-4fe4-b0b8-216dc9a794bb. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.network.neutron [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updating instance_info_cache with network_info: [{"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] Releasing lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received event network-vif-plugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] Acquiring lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] No waiting events found dispatching network-vif-plugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:50 user nova-compute[73029]: WARNING nova.compute.manager [req-781c0666-f0b8-4510-887b-b2bb9bf676d5 req-519a1dae-1a68-4136-8891-a6037cc58a7e service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received unexpected event network-vif-plugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb for instance with vm_state active and task_state None.
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:35:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] No VIF found with MAC fa:16:3e:a9:15:c8, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received event network-changed-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Refreshing instance network info cache due to event network-changed-fec11eed-17da-425c-89be-003dfd7f60c6. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] Acquiring lock "refresh_cache-77e0dc6b-541f-4032-9f93-f0cc395b0a22" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] Acquired lock "refresh_cache-77e0dc6b-541f-4032-9f93-f0cc395b0a22" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG nova.network.neutron [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Refreshing network info cache for port fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-a4ad3257-6dff-48be-9850-cc7d52ec4d88 req-17084253-2ffd-40b2-aefe-22360c5464cc service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received event network-vif-plugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a4ad3257-6dff-48be-9850-cc7d52ec4d88 req-17084253-2ffd-40b2-aefe-22360c5464cc service nova] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a4ad3257-6dff-48be-9850-cc7d52ec4d88 req-17084253-2ffd-40b2-aefe-22360c5464cc service nova] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a4ad3257-6dff-48be-9850-cc7d52ec4d88 req-17084253-2ffd-40b2-aefe-22360c5464cc service nova] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-a4ad3257-6dff-48be-9850-cc7d52ec4d88 req-17084253-2ffd-40b2-aefe-22360c5464cc service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] No waiting events found dispatching network-vif-plugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:51 user nova-compute[73029]: WARNING nova.compute.manager [req-a4ad3257-6dff-48be-9850-cc7d52ec4d88 req-17084253-2ffd-40b2-aefe-22360c5464cc service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received unexpected event network-vif-plugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb for instance with vm_state building and task_state spawning.
Aug 10 00:35:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:35:52 user nova-compute[73029]: INFO nova.compute.claims [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Claim successful on node user
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Updated VIF entry in instance network info cache for port fec11eed-17da-425c-89be-003dfd7f60c6. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Updating instance_info_cache with network_info: [{"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] Releasing lock "refresh_cache-77e0dc6b-541f-4032-9f93-f0cc395b0a22" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received event network-vif-plugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] Acquiring lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] No waiting events found dispatching network-vif-plugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:52 user nova-compute[73029]: WARNING nova.compute.manager [req-397fe347-3cb0-4de5-ac74-54054a0c4d60 req-0db1f3c9-2dab-4ba8-b05a-6e53cd66c006 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received unexpected event network-vif-plugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb for instance with vm_state active and task_state None.
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:35:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:35:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:35:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG nova.policy [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b480acf3baa421ba056043c717e942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8942a3a3544a2dac7a3a89a864dd0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:35:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Creating image(s)
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.322s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-85cf8492-1765-4204-9be3-f6fbc1eed900 req-f34ab6eb-de0d-4710-8023-8438f21e4cb8 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received event network-vif-plugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-85cf8492-1765-4204-9be3-f6fbc1eed900 req-f34ab6eb-de0d-4710-8023-8438f21e4cb8 service nova] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-85cf8492-1765-4204-9be3-f6fbc1eed900 req-f34ab6eb-de0d-4710-8023-8438f21e4cb8 service nova] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-85cf8492-1765-4204-9be3-f6fbc1eed900 req-f34ab6eb-de0d-4710-8023-8438f21e4cb8 service nova] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-85cf8492-1765-4204-9be3-f6fbc1eed900 req-f34ab6eb-de0d-4710-8023-8438f21e4cb8 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] No waiting events found dispatching network-vif-plugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:53 user nova-compute[73029]: WARNING nova.compute.manager [req-85cf8492-1765-4204-9be3-f6fbc1eed900 req-f34ab6eb-de0d-4710-8023-8438f21e4cb8 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received unexpected event network-vif-plugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb for instance with vm_state building and task_state spawning.
Aug 10 00:35:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-0733d69d-c671-4033-9329-1b01055fdf54 req-9698d90b-63d2-4c92-bbf7-ce400f5a6cb7 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received event network-vif-plugged-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0733d69d-c671-4033-9329-1b01055fdf54 req-9698d90b-63d2-4c92-bbf7-ce400f5a6cb7 service nova] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0733d69d-c671-4033-9329-1b01055fdf54 req-9698d90b-63d2-4c92-bbf7-ce400f5a6cb7 service nova] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0733d69d-c671-4033-9329-1b01055fdf54 req-9698d90b-63d2-4c92-bbf7-ce400f5a6cb7 service nova] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-0733d69d-c671-4033-9329-1b01055fdf54 req-9698d90b-63d2-4c92-bbf7-ce400f5a6cb7 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] No waiting events found dispatching network-vif-plugged-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:53 user nova-compute[73029]: WARNING nova.compute.manager [req-0733d69d-c671-4033-9329-1b01055fdf54 req-9698d90b-63d2-4c92-bbf7-ce400f5a6cb7 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received unexpected event network-vif-plugged-fec11eed-17da-425c-89be-003dfd7f60c6 for instance with vm_state building and task_state spawning.
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.268s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk 1073741824" returned: 0 in 0.067s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.192s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Checking if we can resize image /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:35:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Cannot resize image /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lazy-loading 'migration_context' on Instance uuid 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Ensure instance console log exists: /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Successfully created port: 05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627755.4354703, e7d1898b-0b2e-4feb-9d06-48e20eb9e409 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] VM Resumed (Lifecycle Event)
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Instance spawned successfully.
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627755.4431107, e7d1898b-0b2e-4feb-9d06-48e20eb9e409 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] VM Started (Lifecycle Event)
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:55 user nova-compute[73029]: INFO nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Took 14.99 seconds to spawn the instance on the hypervisor.
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-4d2df348-8e2f-4345-afcd-a9fed9ab2dad req-18fc0382-0a88-4829-9f8a-ba53821c9036 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received event network-vif-plugged-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d2df348-8e2f-4345-afcd-a9fed9ab2dad req-18fc0382-0a88-4829-9f8a-ba53821c9036 service nova] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d2df348-8e2f-4345-afcd-a9fed9ab2dad req-18fc0382-0a88-4829-9f8a-ba53821c9036 service nova] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d2df348-8e2f-4345-afcd-a9fed9ab2dad req-18fc0382-0a88-4829-9f8a-ba53821c9036 service nova] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-4d2df348-8e2f-4345-afcd-a9fed9ab2dad req-18fc0382-0a88-4829-9f8a-ba53821c9036 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] No waiting events found dispatching network-vif-plugged-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:35:55 user nova-compute[73029]: WARNING nova.compute.manager [req-4d2df348-8e2f-4345-afcd-a9fed9ab2dad req-18fc0382-0a88-4829-9f8a-ba53821c9036 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received unexpected event network-vif-plugged-fec11eed-17da-425c-89be-003dfd7f60c6 for instance with vm_state building and task_state spawning.
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627755.8944175, 77e0dc6b-541f-4032-9f93-f0cc395b0a22 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] VM Resumed (Lifecycle Event)
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Instance spawned successfully.
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:35:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:55 user nova-compute[73029]: INFO nova.compute.manager [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Took 15.85 seconds to build instance.
Aug 10 00:35:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7bb1b130-fb06-4267-84a0-04c7cd2fed05 tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.999s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:56 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627755.8964105, 77e0dc6b-541f-4032-9f93-f0cc395b0a22 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:35:56 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] VM Started (Lifecycle Event)
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:35:56 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:35:56 user nova-compute[73029]: INFO nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Took 12.86 seconds to spawn the instance on the hypervisor.
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:56 user nova-compute[73029]: INFO nova.compute.manager [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Took 13.72 seconds to build instance.
Aug 10 00:35:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a7b23aa-4a21-4e9b-8197-398769f4c7b6 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.924s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Successfully updated port: 05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquired lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-cc5d7f14-afe3-4f1b-86e4-4aaffef4f354 req-17c5c2a0-41a4-49f1-9590-2af544f1a887 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-changed-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-cc5d7f14-afe3-4f1b-86e4-4aaffef4f354 req-17c5c2a0-41a4-49f1-9590-2af544f1a887 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Refreshing instance network info cache due to event network-changed-05000558-c8bc-4dfc-b4de-5debccaa24fe. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc5d7f14-afe3-4f1b-86e4-4aaffef4f354 req-17c5c2a0-41a4-49f1-9590-2af544f1a887 service nova] Acquiring lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:35:56 user nova-compute[73029]: INFO nova.compute.claims [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Claim successful on node user
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updating instance_info_cache with network_info: [{"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Releasing lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Instance network_info: |[{"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc5d7f14-afe3-4f1b-86e4-4aaffef4f354 req-17c5c2a0-41a4-49f1-9590-2af544f1a887 service nova] Acquired lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-cc5d7f14-afe3-4f1b-86e4-4aaffef4f354 req-17c5c2a0-41a4-49f1-9590-2af544f1a887 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Refreshing network info cache for port 05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Start _get_guest_xml network_info=[{"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:35:57 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:57 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-352229283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-352229283',id=7,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSQZlX8tI3HUwW5UVA7H4kJ0KQcIp1DOQA6cc1Hg9qny8FShjYMyHMG2A1DuZmIP9gEfAxzEQzKQ18gbQeFKmztjw82TU4PUw9XXXpr4uKfgwEa89ahnNeAGiXSbMh7qA==',key_name='tempest-keypair-1362690543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db8942a3a3544a2dac7a3a89a864dd0b',ramdisk_id='',reservation_id='r-yhqgxnwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1142167359',owner_user_name='tempest-TaggedAttachmentsTest-1142167359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b480acf3baa421ba056043c717e942f',uuid=118963ea-d3cf-4c10-945f-4718a02412c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converting VIF {"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=05000558-c8bc-4dfc-b4de-5debccaa24fe,network=Network(f6830c69-fe03-4f47-bf3a-397be8001842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05000558-c8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lazy-loading 'pci_devices' on Instance uuid 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:35:57 user nova-compute[73029]:   <uuid>118963ea-d3cf-4c10-945f-4718a02412c1</uuid>
Aug 10 00:35:57 user nova-compute[73029]:   <name>instance-00000007</name>
Aug 10 00:35:57 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:35:57 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:35:57 user nova-compute[73029]:   <metadata>
Aug 10 00:35:57 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:35:57 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:35:57 user nova-compute[73029]:       <nova:name>tempest-device-tagging-server-352229283</nova:name>
Aug 10 00:35:57 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:35:57</nova:creationTime>
Aug 10 00:35:57 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:35:57 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:35:57 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:35:57 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:35:57 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:35:57 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:35:57 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:35:57 user nova-compute[73029]:       <nova:owner>
Aug 10 00:35:57 user nova-compute[73029]:         <nova:user uuid="9b480acf3baa421ba056043c717e942f">tempest-TaggedAttachmentsTest-1142167359-project-member</nova:user>
Aug 10 00:35:57 user nova-compute[73029]:         <nova:project uuid="db8942a3a3544a2dac7a3a89a864dd0b">tempest-TaggedAttachmentsTest-1142167359</nova:project>
Aug 10 00:35:57 user nova-compute[73029]:       </nova:owner>
Aug 10 00:35:57 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:35:57 user nova-compute[73029]:       <nova:ports>
Aug 10 00:35:57 user nova-compute[73029]:         <nova:port uuid="05000558-c8bc-4dfc-b4de-5debccaa24fe">
Aug 10 00:35:57 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 00:35:57 user nova-compute[73029]:         </nova:port>
Aug 10 00:35:57 user nova-compute[73029]:       </nova:ports>
Aug 10 00:35:57 user nova-compute[73029]:     </nova:instance>
Aug 10 00:35:57 user nova-compute[73029]:   </metadata>
Aug 10 00:35:57 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:35:57 user nova-compute[73029]:     <system>
Aug 10 00:35:57 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:35:57 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:35:57 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:35:57 user nova-compute[73029]:       <entry name="serial">118963ea-d3cf-4c10-945f-4718a02412c1</entry>
Aug 10 00:35:57 user nova-compute[73029]:       <entry name="uuid">118963ea-d3cf-4c10-945f-4718a02412c1</entry>
Aug 10 00:35:57 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:35:57 user nova-compute[73029]:     </system>
Aug 10 00:35:57 user nova-compute[73029]:   </sysinfo>
Aug 10 00:35:57 user nova-compute[73029]:   <os>
Aug 10 00:35:57 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:35:57 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:35:57 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:35:57 user nova-compute[73029]:   </os>
Aug 10 00:35:57 user nova-compute[73029]:   <features>
Aug 10 00:35:57 user nova-compute[73029]:     <acpi/>
Aug 10 00:35:57 user nova-compute[73029]:     <apic/>
Aug 10 00:35:57 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:35:57 user nova-compute[73029]:   </features>
Aug 10 00:35:57 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:35:57 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:35:57 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:35:57 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:35:57 user nova-compute[73029]:   </clock>
Aug 10 00:35:57 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:35:57 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:35:57 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:35:57 user nova-compute[73029]:   </cpu>
Aug 10 00:35:57 user nova-compute[73029]:   <devices>
Aug 10 00:35:57 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:35:57 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:35:57 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk"/>
Aug 10 00:35:57 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:35:57 user nova-compute[73029]:     </disk>
Aug 10 00:35:57 user nova-compute[73029]:     <disk type="file" device="cdrom">
Aug 10 00:35:57 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none"/>
Aug 10 00:35:57 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk.config"/>
Aug 10 00:35:57 user nova-compute[73029]:       <target dev="hda" bus="ide"/>
Aug 10 00:35:57 user nova-compute[73029]:     </disk>
Aug 10 00:35:57 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:35:57 user nova-compute[73029]:       <mac address="fa:16:3e:d0:f6:08"/>
Aug 10 00:35:57 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:57 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:35:57 user nova-compute[73029]:       <target dev="tap05000558-c8"/>
Aug 10 00:35:57 user nova-compute[73029]:     </interface>
Aug 10 00:35:57 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:35:57 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/console.log" append="off"/>
Aug 10 00:35:57 user nova-compute[73029]:     </serial>
Aug 10 00:35:57 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:35:57 user nova-compute[73029]:     <video>
Aug 10 00:35:57 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:35:57 user nova-compute[73029]:     </video>
Aug 10 00:35:57 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:35:57 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:35:57 user nova-compute[73029]:     </rng>
Aug 10 00:35:57 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:35:57 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:35:57 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:35:57 user nova-compute[73029]:     </memballoon>
Aug 10 00:35:57 user nova-compute[73029]:   </devices>
Aug 10 00:35:57 user nova-compute[73029]: </domain>
Aug 10 00:35:57 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-352229283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-352229283',id=7,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSQZlX8tI3HUwW5UVA7H4kJ0KQcIp1DOQA6cc1Hg9qny8FShjYMyHMG2A1DuZmIP9gEfAxzEQzKQ18gbQeFKmztjw82TU4PUw9XXXpr4uKfgwEa89ahnNeAGiXSbMh7qA==',key_name='tempest-keypair-1362690543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db8942a3a3544a2dac7a3a89a864dd0b',ramdisk_id='',reservation_id='r-yhqgxnwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1142167359',owner_user_name='tempest-TaggedAttachmentsTest-1142167359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b480acf3baa421ba056043c717e942f',uuid=118963ea-d3cf-4c10-945f-4718a02412c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converting VIF {"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=05000558-c8bc-4dfc-b4de-5debccaa24fe,network=Network(f6830c69-fe03-4f47-bf3a-397be8001842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05000558-c8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG os_vif [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=05000558-c8bc-4dfc-b4de-5debccaa24fe,network=Network(f6830c69-fe03-4f47-bf3a-397be8001842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05000558-c8') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05000558-c8, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05000558-c8, col_values=(('external_ids', {'iface-id': '05000558-c8bc-4dfc-b4de-5debccaa24fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:f6:08', 'vm-uuid': '118963ea-d3cf-4c10-945f-4718a02412c1'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:57 user nova-compute[73029]: INFO os_vif [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=05000558-c8bc-4dfc-b4de-5debccaa24fe,network=Network(f6830c69-fe03-4f47-bf3a-397be8001842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05000558-c8')
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] No BDM found with device name hda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] No VIF found with MAC fa:16:3e:d0:f6:08, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:35:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Using config drive
Aug 10 00:35:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.956s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:35:58 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 10 00:35:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:35:58 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Creating image(s)
Aug 10 00:35:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "/opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "/opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "/opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "3214e1c05655f4aef52e982af165d64ffdb32db9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "3214e1c05655f4aef52e982af165d64ffdb32db9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:35:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG nova.policy [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36d1a470fba043808d32340dec8ca7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6605cb164b405ba6654ed17bc106cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:35:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Creating config drive at /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk.config
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvxtbk1yw {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG nova.network.neutron [req-cc5d7f14-afe3-4f1b-86e4-4aaffef4f354 req-17c5c2a0-41a4-49f1-9590-2af544f1a887 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updated VIF entry in instance network info cache for port 05000558-c8bc-4dfc-b4de-5debccaa24fe. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG nova.network.neutron [req-cc5d7f14-afe3-4f1b-86e4-4aaffef4f354 req-17c5c2a0-41a4-49f1-9590-2af544f1a887 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updating instance_info_cache with network_info: [{"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvxtbk1yw" returned: 0 in 0.105s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc5d7f14-afe3-4f1b-86e4-4aaffef4f354 req-17c5c2a0-41a4-49f1-9590-2af544f1a887 service nova] Releasing lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9.part --force-share --output=json" returned: 0 in 0.337s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG nova.virt.images [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] 8299476b-1d45-4d53-9a29-947ccb8e20db was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9.part /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9.part /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9.converted" returned: 0 in 0.330s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "3214e1c05655f4aef52e982af165d64ffdb32db9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.380s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:35:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9 --force-share --output=json" returned: 0 in 0.312s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "3214e1c05655f4aef52e982af165d64ffdb32db9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "3214e1c05655f4aef52e982af165d64ffdb32db9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9 --force-share --output=json" returned: 0 in 0.324s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9,backing_fmt=raw /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9,backing_fmt=raw /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk 1073741824" returned: 0 in 0.178s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "3214e1c05655f4aef52e982af165d64ffdb32db9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.510s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Successfully created port: 70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9 --force-share --output=json" returned: 0 in 0.230s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:36:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Cannot resize image /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG nova.objects.instance [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lazy-loading 'migration_context' on Instance uuid 68b798ae-944c-40f4-9747-79d60e9bf6ee {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Ensure instance console log exists: /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.014s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:02 user nova-compute[73029]: DEBUG nova.compute.manager [req-3227f061-659a-428b-9578-4d2c3a3ba38d req-26bd4fb2-8fee-4317-be0e-426cd8d62434 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-plugged-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3227f061-659a-428b-9578-4d2c3a3ba38d req-26bd4fb2-8fee-4317-be0e-426cd8d62434 service nova] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3227f061-659a-428b-9578-4d2c3a3ba38d req-26bd4fb2-8fee-4317-be0e-426cd8d62434 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3227f061-659a-428b-9578-4d2c3a3ba38d req-26bd4fb2-8fee-4317-be0e-426cd8d62434 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:02 user nova-compute[73029]: DEBUG nova.compute.manager [req-3227f061-659a-428b-9578-4d2c3a3ba38d req-26bd4fb2-8fee-4317-be0e-426cd8d62434 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] No waiting events found dispatching network-vif-plugged-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:36:02 user nova-compute[73029]: WARNING nova.compute.manager [req-3227f061-659a-428b-9578-4d2c3a3ba38d req-26bd4fb2-8fee-4317-be0e-426cd8d62434 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received unexpected event network-vif-plugged-05000558-c8bc-4dfc-b4de-5debccaa24fe for instance with vm_state building and task_state spawning.
Aug 10 00:36:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Successfully updated port: 70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "refresh_cache-68b798ae-944c-40f4-9747-79d60e9bf6ee" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquired lock "refresh_cache-68b798ae-944c-40f4-9747-79d60e9bf6ee" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Updating instance_info_cache with network_info: [{"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Releasing lock "refresh_cache-68b798ae-944c-40f4-9747-79d60e9bf6ee" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Instance network_info: |[{"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Start _get_guest_xml network_info=[{"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:35:46Z,direct_url=<?>,disk_format='qcow2',id=8299476b-1d45-4d53-9a29-947ccb8e20db,min_disk=0,min_ram=0,name='',owner='5cb3ef5274d546ca9861f0c38f130d24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:35:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '8299476b-1d45-4d53-9a29-947ccb8e20db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:36:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:36:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:35:46Z,direct_url=<?>,disk_format='qcow2',id=8299476b-1d45-4d53-9a29-947ccb8e20db,min_disk=0,min_ram=0,name='',owner='5cb3ef5274d546ca9861f0c38f130d24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:35:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-168337976',display_name='tempest-AttachSCSIVolumeTestJSON-server-168337976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-168337976',id=8,image_ref='8299476b-1d45-4d53-9a29-947ccb8e20db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyRlDGB9GkKv2QceB/A5gbgez+rMJkMemiLz/eupJ5NKS7KDTk15mSfoXSLRJ2PF3gPBdD4em/hO+rcbJ+SJ5RBLq5/wy6aKtKMeMZcWPUhDqEHXaob5+626BriCNLcjw==',key_name='tempest-keypair-170495231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c6605cb164b405ba6654ed17bc106cb',ramdisk_id='',reservation_id='r-fgbse67x',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8299476b-1d45-4d53-9a29-947ccb8e20db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1385797763',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1385797763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36d1a470fba043808d32340dec8ca7b3',uuid=68b798ae-944c-40f4-9747-79d60e9bf6ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Converting VIF {"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=70ffb577-36a7-4e12-af57-d8d6afbbd5cd,network=Network(7d6b7e87-27a1-4971-8549-f281f9b6b09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ffb577-36') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.objects.instance [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lazy-loading 'pci_devices' on Instance uuid 68b798ae-944c-40f4-9747-79d60e9bf6ee {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627763.8247778, 118963ea-d3cf-4c10-945f-4718a02412c1 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:36:03 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] VM Resumed (Lifecycle Event)
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:36:03 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Instance spawned successfully.
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:36:03 user nova-compute[73029]:   <uuid>68b798ae-944c-40f4-9747-79d60e9bf6ee</uuid>
Aug 10 00:36:03 user nova-compute[73029]:   <name>instance-00000008</name>
Aug 10 00:36:03 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:36:03 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:36:03 user nova-compute[73029]:   <metadata>
Aug 10 00:36:03 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:36:03 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:36:03 user nova-compute[73029]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-168337976</nova:name>
Aug 10 00:36:03 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:36:03</nova:creationTime>
Aug 10 00:36:03 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:36:03 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:36:03 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:36:03 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:36:03 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:36:03 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:36:03 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:36:03 user nova-compute[73029]:       <nova:owner>
Aug 10 00:36:03 user nova-compute[73029]:         <nova:user uuid="36d1a470fba043808d32340dec8ca7b3">tempest-AttachSCSIVolumeTestJSON-1385797763-project-member</nova:user>
Aug 10 00:36:03 user nova-compute[73029]:         <nova:project uuid="8c6605cb164b405ba6654ed17bc106cb">tempest-AttachSCSIVolumeTestJSON-1385797763</nova:project>
Aug 10 00:36:03 user nova-compute[73029]:       </nova:owner>
Aug 10 00:36:03 user nova-compute[73029]:       <nova:root type="image" uuid="8299476b-1d45-4d53-9a29-947ccb8e20db"/>
Aug 10 00:36:03 user nova-compute[73029]:       <nova:ports>
Aug 10 00:36:03 user nova-compute[73029]:         <nova:port uuid="70ffb577-36a7-4e12-af57-d8d6afbbd5cd">
Aug 10 00:36:03 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 10 00:36:03 user nova-compute[73029]:         </nova:port>
Aug 10 00:36:03 user nova-compute[73029]:       </nova:ports>
Aug 10 00:36:03 user nova-compute[73029]:     </nova:instance>
Aug 10 00:36:03 user nova-compute[73029]:   </metadata>
Aug 10 00:36:03 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:36:03 user nova-compute[73029]:     <system>
Aug 10 00:36:03 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:36:03 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:36:03 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:36:03 user nova-compute[73029]:       <entry name="serial">68b798ae-944c-40f4-9747-79d60e9bf6ee</entry>
Aug 10 00:36:03 user nova-compute[73029]:       <entry name="uuid">68b798ae-944c-40f4-9747-79d60e9bf6ee</entry>
Aug 10 00:36:03 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:36:03 user nova-compute[73029]:     </system>
Aug 10 00:36:03 user nova-compute[73029]:   </sysinfo>
Aug 10 00:36:03 user nova-compute[73029]:   <os>
Aug 10 00:36:03 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:36:03 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:36:03 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:36:03 user nova-compute[73029]:   </os>
Aug 10 00:36:03 user nova-compute[73029]:   <features>
Aug 10 00:36:03 user nova-compute[73029]:     <acpi/>
Aug 10 00:36:03 user nova-compute[73029]:     <apic/>
Aug 10 00:36:03 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:36:03 user nova-compute[73029]:   </features>
Aug 10 00:36:03 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:36:03 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:36:03 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:36:03 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:36:03 user nova-compute[73029]:   </clock>
Aug 10 00:36:03 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:36:03 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:36:03 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:36:03 user nova-compute[73029]:   </cpu>
Aug 10 00:36:03 user nova-compute[73029]:   <devices>
Aug 10 00:36:03 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:36:03 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:36:03 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk"/>
Aug 10 00:36:03 user nova-compute[73029]:       <target dev="sda" bus="scsi"/>
Aug 10 00:36:03 user nova-compute[73029]:       <address type="drive" controller="0" unit="0"/>
Aug 10 00:36:03 user nova-compute[73029]:     </disk>
Aug 10 00:36:03 user nova-compute[73029]:     <disk type="file" device="cdrom">
Aug 10 00:36:03 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none"/>
Aug 10 00:36:03 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk.config"/>
Aug 10 00:36:03 user nova-compute[73029]:       <target dev="sdb" bus="scsi"/>
Aug 10 00:36:03 user nova-compute[73029]:       <address type="drive" controller="0" unit="1"/>
Aug 10 00:36:03 user nova-compute[73029]:     </disk>
Aug 10 00:36:03 user nova-compute[73029]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 10 00:36:03 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:36:03 user nova-compute[73029]:       <mac address="fa:16:3e:3f:b4:36"/>
Aug 10 00:36:03 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:36:03 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:36:03 user nova-compute[73029]:       <target dev="tap70ffb577-36"/>
Aug 10 00:36:03 user nova-compute[73029]:     </interface>
Aug 10 00:36:03 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:36:03 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/console.log" append="off"/>
Aug 10 00:36:03 user nova-compute[73029]:     </serial>
Aug 10 00:36:03 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:36:03 user nova-compute[73029]:     <video>
Aug 10 00:36:03 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:36:03 user nova-compute[73029]:     </video>
Aug 10 00:36:03 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:36:03 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:36:03 user nova-compute[73029]:     </rng>
Aug 10 00:36:03 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:36:03 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:36:03 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:36:03 user nova-compute[73029]:     </memballoon>
Aug 10 00:36:03 user nova-compute[73029]:   </devices>
Aug 10 00:36:03 user nova-compute[73029]: </domain>
Aug 10 00:36:03 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-168337976',display_name='tempest-AttachSCSIVolumeTestJSON-server-168337976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-168337976',id=8,image_ref='8299476b-1d45-4d53-9a29-947ccb8e20db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyRlDGB9GkKv2QceB/A5gbgez+rMJkMemiLz/eupJ5NKS7KDTk15mSfoXSLRJ2PF3gPBdD4em/hO+rcbJ+SJ5RBLq5/wy6aKtKMeMZcWPUhDqEHXaob5+626BriCNLcjw==',key_name='tempest-keypair-170495231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c6605cb164b405ba6654ed17bc106cb',ramdisk_id='',reservation_id='r-fgbse67x',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8299476b-1d45-4d53-9a29-947ccb8e20db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1385797763',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1385797763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36d1a470fba043808d32340dec8ca7b3',uuid=68b798ae-944c-40f4-9747-79d60e9bf6ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Converting VIF {"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=70ffb577-36a7-4e12-af57-d8d6afbbd5cd,network=Network(7d6b7e87-27a1-4971-8549-f281f9b6b09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ffb577-36') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG os_vif [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=70ffb577-36a7-4e12-af57-d8d6afbbd5cd,network=Network(7d6b7e87-27a1-4971-8549-f281f9b6b09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ffb577-36') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70ffb577-36, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70ffb577-36, col_values=(('external_ids', {'iface-id': '70ffb577-36a7-4e12-af57-d8d6afbbd5cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:b4:36', 'vm-uuid': '68b798ae-944c-40f4-9747-79d60e9bf6ee'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:03 user nova-compute[73029]: INFO os_vif [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=70ffb577-36a7-4e12-af57-d8d6afbbd5cd,network=Network(7d6b7e87-27a1-4971-8549-f281f9b6b09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ffb577-36')
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:04 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627763.8251562, 118963ea-d3cf-4c10-945f-4718a02412c1 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:36:04 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] VM Started (Lifecycle Event)
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.compute.manager [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-plugged-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.compute.manager [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] No waiting events found dispatching network-vif-plugged-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:36:04 user nova-compute[73029]: WARNING nova.compute.manager [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received unexpected event network-vif-plugged-05000558-c8bc-4dfc-b4de-5debccaa24fe for instance with vm_state building and task_state spawning.
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.compute.manager [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-changed-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.compute.manager [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Refreshing instance network info cache due to event network-changed-70ffb577-36a7-4e12-af57-d8d6afbbd5cd. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] Acquiring lock "refresh_cache-68b798ae-944c-40f4-9747-79d60e9bf6ee" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] Acquired lock "refresh_cache-68b798ae-944c-40f4-9747-79d60e9bf6ee" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.network.neutron [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Refreshing network info cache for port 70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:04 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] No BDM found with device name sda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] No VIF found with MAC fa:16:3e:3f:b4:36, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:36:04 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Using config drive
Aug 10 00:36:04 user nova-compute[73029]: INFO nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Took 11.08 seconds to spawn the instance on the hypervisor.
Aug 10 00:36:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:36:04 user nova-compute[73029]: INFO nova.compute.manager [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Took 12.32 seconds to build instance.
Aug 10 00:36:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e264ff8-1a2f-4f5f-9045-ed5c1b5fdc8a tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.515s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:04 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Creating config drive at /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk.config
Aug 10 00:36:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqa9ry865 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqa9ry865" returned: 0 in 0.076s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:05 user nova-compute[73029]: DEBUG nova.network.neutron [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Updated VIF entry in instance network info cache for port 70ffb577-36a7-4e12-af57-d8d6afbbd5cd. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:36:05 user nova-compute[73029]: DEBUG nova.network.neutron [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Updating instance_info_cache with network_info: [{"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9e42eaea-8891-4598-9d7f-3631ce3897c8 req-a5c2f6f3-2078-40e5-a122-cd9fceac3a06 service nova] Releasing lock "refresh_cache-68b798ae-944c-40f4-9747-79d60e9bf6ee" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-838c71de-b3f5-4486-97b6-0752f2acca6f req-1e14cf7f-dde9-42dd-ad86-a5ff53eefe94 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-838c71de-b3f5-4486-97b6-0752f2acca6f req-1e14cf7f-dde9-42dd-ad86-a5ff53eefe94 service nova] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-838c71de-b3f5-4486-97b6-0752f2acca6f req-1e14cf7f-dde9-42dd-ad86-a5ff53eefe94 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-838c71de-b3f5-4486-97b6-0752f2acca6f req-1e14cf7f-dde9-42dd-ad86-a5ff53eefe94 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-838c71de-b3f5-4486-97b6-0752f2acca6f req-1e14cf7f-dde9-42dd-ad86-a5ff53eefe94 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] No waiting events found dispatching network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:36:06 user nova-compute[73029]: WARNING nova.compute.manager [req-838c71de-b3f5-4486-97b6-0752f2acca6f req-1e14cf7f-dde9-42dd-ad86-a5ff53eefe94 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received unexpected event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd for instance with vm_state building and task_state spawning.
Aug 10 00:36:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627768.5663526, 68b798ae-944c-40f4-9747-79d60e9bf6ee => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:36:08 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] VM Resumed (Lifecycle Event)
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:36:08 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Instance spawned successfully.
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:36:08 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627768.5665457, 68b798ae-944c-40f4-9747-79d60e9bf6ee => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:36:08 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] VM Started (Lifecycle Event)
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:36:08 user nova-compute[73029]: INFO nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Took 10.21 seconds to spawn the instance on the hypervisor.
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:36:08 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:36:08 user nova-compute[73029]: INFO nova.compute.manager [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Took 12.29 seconds to build instance.
Aug 10 00:36:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7acd45cf-1c65-49a4-9c49-de6d83a11cd9 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.508s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-8fa0bedc-62c2-48be-907e-9b138ccadd85 req-6557ebc5-f225-4135-a25a-4345c9b45a5d service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8fa0bedc-62c2-48be-907e-9b138ccadd85 req-6557ebc5-f225-4135-a25a-4345c9b45a5d service nova] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8fa0bedc-62c2-48be-907e-9b138ccadd85 req-6557ebc5-f225-4135-a25a-4345c9b45a5d service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8fa0bedc-62c2-48be-907e-9b138ccadd85 req-6557ebc5-f225-4135-a25a-4345c9b45a5d service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-8fa0bedc-62c2-48be-907e-9b138ccadd85 req-6557ebc5-f225-4135-a25a-4345c9b45a5d service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] No waiting events found dispatching network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:36:08 user nova-compute[73029]: WARNING nova.compute.manager [req-8fa0bedc-62c2-48be-907e-9b138ccadd85 req-6557ebc5-f225-4135-a25a-4345c9b45a5d service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received unexpected event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd for instance with vm_state active and task_state None.
Aug 10 00:36:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:09 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:36:09 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 00:36:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-0012ccc2-0fdf-4bdc-84c7-be4279032bdd" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-0012ccc2-0fdf-4bdc-84c7-be4279032bdd" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:09 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:36:09 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 0012ccc2-0fdf-4bdc-84c7-be4279032bdd {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Updating instance_info_cache with network_info: [{"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-0012ccc2-0fdf-4bdc-84c7-be4279032bdd" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquiring lock "37790055-25a9-4304-891e-17ccd8b0f46d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "37790055-25a9-4304-891e-17ccd8b0f46d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:13 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:36:13 user nova-compute[73029]: INFO nova.compute.claims [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Claim successful on node user
Aug 10 00:36:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:36:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:36:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7619MB free_disk=25.619789123535156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:14 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:36:14 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.490s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.645s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:36:14 user nova-compute[73029]: DEBUG nova.network.neutron [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:36:15 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 0012ccc2-0fdf-4bdc-84c7-be4279032bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 118963ea-d3cf-4c10-945f-4718a02412c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 68b798ae-944c-40f4-9747-79d60e9bf6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 37790055-25a9-4304-891e-17ccd8b0f46d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.policy [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a9bf00a9efe4e068dbc96fdc589610c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f807e9040ec84d4cbd12b36358d8007d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:36:15 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Creating image(s)
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquiring lock "/opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "/opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "/opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.168s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.190s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk 1073741824" returned: 0 in 0.072s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.178s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:36:15 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.082s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Cannot resize image /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG nova.objects.instance [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lazy-loading 'migration_context' on Instance uuid 37790055-25a9-4304-891e-17ccd8b0f46d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Ensure instance console log exists: /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Successfully created port: 98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:36:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Successfully updated port: 98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquiring lock "refresh_cache-37790055-25a9-4304-891e-17ccd8b0f46d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquired lock "refresh_cache-37790055-25a9-4304-891e-17ccd8b0f46d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.compute.manager [req-1c9a1a75-a2af-43e6-a868-877a0601d8c8 req-90696db4-db76-449f-a3a8-83499610f708 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received event network-changed-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.compute.manager [req-1c9a1a75-a2af-43e6-a868-877a0601d8c8 req-90696db4-db76-449f-a3a8-83499610f708 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Refreshing instance network info cache due to event network-changed-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1c9a1a75-a2af-43e6-a868-877a0601d8c8 req-90696db4-db76-449f-a3a8-83499610f708 service nova] Acquiring lock "refresh_cache-37790055-25a9-4304-891e-17ccd8b0f46d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Updating instance_info_cache with network_info: [{"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Releasing lock "refresh_cache-37790055-25a9-4304-891e-17ccd8b0f46d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Instance network_info: |[{"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1c9a1a75-a2af-43e6-a868-877a0601d8c8 req-90696db4-db76-449f-a3a8-83499610f708 service nova] Acquired lock "refresh_cache-37790055-25a9-4304-891e-17ccd8b0f46d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.network.neutron [req-1c9a1a75-a2af-43e6-a868-877a0601d8c8 req-90696db4-db76-449f-a3a8-83499610f708 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Refreshing network info cache for port 98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Start _get_guest_xml network_info=[{"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:36:17 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:36:17 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1772786510',display_name='tempest-VolumesActionsTest-instance-1772786510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1772786510',id=9,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f807e9040ec84d4cbd12b36358d8007d',ramdisk_id='',reservation_id='r-yoxjy5yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1817209675',owner_user_name='tempest-VolumesActionsTest-1817209675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:15Z,user_data=None,user_id='3a9bf00a9efe4e068dbc96fdc589610c',uuid=37790055-25a9-4304-891e-17ccd8b0f46d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Converting VIF {"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:37,bridge_name='br-int',has_traffic_filtering=True,id=98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50,network=Network(7fc118f9-9ad5-46f6-9f36-68db61a1b39d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ddc1b4-0b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lazy-loading 'pci_devices' on Instance uuid 37790055-25a9-4304-891e-17ccd8b0f46d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:36:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:36:17 user nova-compute[73029]:   <uuid>37790055-25a9-4304-891e-17ccd8b0f46d</uuid>
Aug 10 00:36:17 user nova-compute[73029]:   <name>instance-00000009</name>
Aug 10 00:36:17 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:36:17 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:36:17 user nova-compute[73029]:   <metadata>
Aug 10 00:36:17 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:36:17 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:36:17 user nova-compute[73029]:       <nova:name>tempest-VolumesActionsTest-instance-1772786510</nova:name>
Aug 10 00:36:17 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:36:17</nova:creationTime>
Aug 10 00:36:17 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:36:17 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:36:17 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:36:17 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:36:17 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:36:17 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:36:17 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:36:17 user nova-compute[73029]:       <nova:owner>
Aug 10 00:36:17 user nova-compute[73029]:         <nova:user uuid="3a9bf00a9efe4e068dbc96fdc589610c">tempest-VolumesActionsTest-1817209675-project-member</nova:user>
Aug 10 00:36:17 user nova-compute[73029]:         <nova:project uuid="f807e9040ec84d4cbd12b36358d8007d">tempest-VolumesActionsTest-1817209675</nova:project>
Aug 10 00:36:17 user nova-compute[73029]:       </nova:owner>
Aug 10 00:36:17 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:36:17 user nova-compute[73029]:       <nova:ports>
Aug 10 00:36:17 user nova-compute[73029]:         <nova:port uuid="98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50">
Aug 10 00:36:17 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 00:36:17 user nova-compute[73029]:         </nova:port>
Aug 10 00:36:17 user nova-compute[73029]:       </nova:ports>
Aug 10 00:36:17 user nova-compute[73029]:     </nova:instance>
Aug 10 00:36:17 user nova-compute[73029]:   </metadata>
Aug 10 00:36:17 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:36:17 user nova-compute[73029]:     <system>
Aug 10 00:36:17 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:36:17 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:36:17 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:36:17 user nova-compute[73029]:       <entry name="serial">37790055-25a9-4304-891e-17ccd8b0f46d</entry>
Aug 10 00:36:17 user nova-compute[73029]:       <entry name="uuid">37790055-25a9-4304-891e-17ccd8b0f46d</entry>
Aug 10 00:36:17 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:36:17 user nova-compute[73029]:     </system>
Aug 10 00:36:17 user nova-compute[73029]:   </sysinfo>
Aug 10 00:36:17 user nova-compute[73029]:   <os>
Aug 10 00:36:17 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:36:17 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:36:17 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:36:17 user nova-compute[73029]:   </os>
Aug 10 00:36:17 user nova-compute[73029]:   <features>
Aug 10 00:36:17 user nova-compute[73029]:     <acpi/>
Aug 10 00:36:17 user nova-compute[73029]:     <apic/>
Aug 10 00:36:17 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:36:17 user nova-compute[73029]:   </features>
Aug 10 00:36:17 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:36:17 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:36:17 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:36:17 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:36:17 user nova-compute[73029]:   </clock>
Aug 10 00:36:17 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:36:17 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:36:17 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:36:17 user nova-compute[73029]:   </cpu>
Aug 10 00:36:17 user nova-compute[73029]:   <devices>
Aug 10 00:36:17 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:36:17 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:36:17 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk"/>
Aug 10 00:36:17 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:36:17 user nova-compute[73029]:     </disk>
Aug 10 00:36:17 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:36:17 user nova-compute[73029]:       <mac address="fa:16:3e:af:83:37"/>
Aug 10 00:36:17 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:36:17 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:36:17 user nova-compute[73029]:       <target dev="tap98ddc1b4-0b"/>
Aug 10 00:36:17 user nova-compute[73029]:     </interface>
Aug 10 00:36:17 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:36:17 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/console.log" append="off"/>
Aug 10 00:36:17 user nova-compute[73029]:     </serial>
Aug 10 00:36:17 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:36:17 user nova-compute[73029]:     <video>
Aug 10 00:36:17 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:36:17 user nova-compute[73029]:     </video>
Aug 10 00:36:17 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:36:17 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:36:17 user nova-compute[73029]:     </rng>
Aug 10 00:36:17 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:36:17 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:36:17 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:36:17 user nova-compute[73029]:     </memballoon>
Aug 10 00:36:17 user nova-compute[73029]:   </devices>
Aug 10 00:36:17 user nova-compute[73029]: </domain>
Aug 10 00:36:17 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1772786510',display_name='tempest-VolumesActionsTest-instance-1772786510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1772786510',id=9,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f807e9040ec84d4cbd12b36358d8007d',ramdisk_id='',reservation_id='r-yoxjy5yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1817209675',owner_user_name='tempest-VolumesActionsTest-1817209675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:15Z,user_data=None,user_id='3a9bf00a9efe4e068dbc96fdc589610c',uuid=37790055-25a9-4304-891e-17ccd8b0f46d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Converting VIF {"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:37,bridge_name='br-int',has_traffic_filtering=True,id=98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50,network=Network(7fc118f9-9ad5-46f6-9f36-68db61a1b39d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ddc1b4-0b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG os_vif [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:37,bridge_name='br-int',has_traffic_filtering=True,id=98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50,network=Network(7fc118f9-9ad5-46f6-9f36-68db61a1b39d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ddc1b4-0b') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98ddc1b4-0b, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98ddc1b4-0b, col_values=(('external_ids', {'iface-id': '98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:83:37', 'vm-uuid': '37790055-25a9-4304-891e-17ccd8b0f46d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:18 user nova-compute[73029]: INFO os_vif [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:37,bridge_name='br-int',has_traffic_filtering=True,id=98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50,network=Network(7fc118f9-9ad5-46f6-9f36-68db61a1b39d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ddc1b4-0b')
Aug 10 00:36:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] No VIF found with MAC fa:16:3e:af:83:37, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG nova.network.neutron [req-1c9a1a75-a2af-43e6-a868-877a0601d8c8 req-90696db4-db76-449f-a3a8-83499610f708 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Updated VIF entry in instance network info cache for port 98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG nova.network.neutron [req-1c9a1a75-a2af-43e6-a868-877a0601d8c8 req-90696db4-db76-449f-a3a8-83499610f708 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Updating instance_info_cache with network_info: [{"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1c9a1a75-a2af-43e6-a868-877a0601d8c8 req-90696db4-db76-449f-a3a8-83499610f708 service nova] Releasing lock "refresh_cache-37790055-25a9-4304-891e-17ccd8b0f46d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-538b165f-f5e8-42a4-8ef8-ac5e9a939e3f req-9181debb-b9af-403f-a818-c9bc9d2bba9f service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received event network-vif-plugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-538b165f-f5e8-42a4-8ef8-ac5e9a939e3f req-9181debb-b9af-403f-a818-c9bc9d2bba9f service nova] Acquiring lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-538b165f-f5e8-42a4-8ef8-ac5e9a939e3f req-9181debb-b9af-403f-a818-c9bc9d2bba9f service nova] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-538b165f-f5e8-42a4-8ef8-ac5e9a939e3f req-9181debb-b9af-403f-a818-c9bc9d2bba9f service nova] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-538b165f-f5e8-42a4-8ef8-ac5e9a939e3f req-9181debb-b9af-403f-a818-c9bc9d2bba9f service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] No waiting events found dispatching network-vif-plugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:36:19 user nova-compute[73029]: WARNING nova.compute.manager [req-538b165f-f5e8-42a4-8ef8-ac5e9a939e3f req-9181debb-b9af-403f-a818-c9bc9d2bba9f service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received unexpected event network-vif-plugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 for instance with vm_state building and task_state spawning.
Aug 10 00:36:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-01bdbbc2-7751-4f25-87f9-60019fd039e0 req-81464f15-6506-4794-8cff-2f38e87fa28e service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received event network-vif-plugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-01bdbbc2-7751-4f25-87f9-60019fd039e0 req-81464f15-6506-4794-8cff-2f38e87fa28e service nova] Acquiring lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-01bdbbc2-7751-4f25-87f9-60019fd039e0 req-81464f15-6506-4794-8cff-2f38e87fa28e service nova] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-01bdbbc2-7751-4f25-87f9-60019fd039e0 req-81464f15-6506-4794-8cff-2f38e87fa28e service nova] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-01bdbbc2-7751-4f25-87f9-60019fd039e0 req-81464f15-6506-4794-8cff-2f38e87fa28e service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] No waiting events found dispatching network-vif-plugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:36:21 user nova-compute[73029]: WARNING nova.compute.manager [req-01bdbbc2-7751-4f25-87f9-60019fd039e0 req-81464f15-6506-4794-8cff-2f38e87fa28e service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received unexpected event network-vif-plugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 for instance with vm_state building and task_state spawning.
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627782.0280876, 37790055-25a9-4304-891e-17ccd8b0f46d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:36:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] VM Resumed (Lifecycle Event)
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:36:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Instance spawned successfully.
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:36:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627782.0298522, 37790055-25a9-4304-891e-17ccd8b0f46d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:36:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] VM Started (Lifecycle Event)
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:36:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:36:22 user nova-compute[73029]: INFO nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Took 6.97 seconds to spawn the instance on the hypervisor.
Aug 10 00:36:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:36:22 user nova-compute[73029]: INFO nova.compute.manager [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Took 8.99 seconds to build instance.
Aug 10 00:36:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-984ef020-d7ad-4b7c-97b9-6109851d02fd tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "37790055-25a9-4304-891e-17ccd8b0f46d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.206s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "866f4abf-6566-4145-a780-953a4615659c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:36:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:36:33 user nova-compute[73029]: INFO nova.compute.claims [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Claim successful on node user
Aug 10 00:36:34 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:36:34 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:36:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:36:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:36:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:36:34 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:36:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:36:34 user nova-compute[73029]: INFO nova.virt.block_device [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Booting with volume 0c76b36f-3752-4309-b922-f4eb0dd8417c at /dev/vda
Aug 10 00:36:34 user nova-compute[73029]: DEBUG nova.policy [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd037b33a7d9740d5b868298dd0551edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb0163154674b4eb8b6116b45917b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:36:34 user nova-compute[73029]: DEBUG os_brick.utils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:36:34 user nova-compute[73029]: INFO oslo.privsep.daemon [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpgxe5r7al/privsep.sock']
Aug 10 00:36:34 user sudo[83989]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpgxe5r7al/privsep.sock
Aug 10 00:36:34 user sudo[83989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 10 00:36:35 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully created port: 2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:35 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully created port: 8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully created port: 7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:36 user sudo[83989]: pam_unix(sudo:session): session closed for user root
Aug 10 00:36:36 user nova-compute[73029]: INFO oslo.privsep.daemon [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Spawned new privsep daemon via rootwrap
Aug 10 00:36:36 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 10 00:36:36 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 10 00:36:36 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 10 00:36:36 user nova-compute[73029]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84041
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243d617-f8fa-4ec8-8c3a-1c430b824179]: (2,) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed767ea-15e9-4430-8afd-c5acf086526a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:36 user nova-compute[73029]: WARNING os_brick.initiator.connectors.nvmeof [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d350532-2738-4698-a9e0-9f1b88091aa5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8839f5-546c-4928-8759-20918abb56d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[55643cbb-1cfa-4f65-a887-ae5ac774cd4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:36 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:36:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[65894c90-c1f7-4143-b785-e6b54bdec346]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG os_brick.utils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] <== get_connector_properties: return (2266ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating existing volume attachment record: 971157d9-3af4-481d-932c-f460fc7011e3 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:36:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully created port: 014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully created port: e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:38 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully updated port: 2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-16e65ebe-1497-4a74-bcd4-48e710bcdf90 req-f9e3bc18-883f-4975-940c-930d36061d35 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-changed-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-16e65ebe-1497-4a74-bcd4-48e710bcdf90 req-f9e3bc18-883f-4975-940c-930d36061d35 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing instance network info cache due to event network-changed-2fb1bff0-2a76-47ab-89c6-9463f7af33fb. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-16e65ebe-1497-4a74-bcd4-48e710bcdf90 req-f9e3bc18-883f-4975-940c-930d36061d35 service nova] Acquiring lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-16e65ebe-1497-4a74-bcd4-48e710bcdf90 req-f9e3bc18-883f-4975-940c-930d36061d35 service nova] Acquired lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:38 user nova-compute[73029]: DEBUG nova.network.neutron [req-16e65ebe-1497-4a74-bcd4-48e710bcdf90 req-f9e3bc18-883f-4975-940c-930d36061d35 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing network info cache for port 2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:38 user nova-compute[73029]: DEBUG nova.network.neutron [req-16e65ebe-1497-4a74-bcd4-48e710bcdf90 req-f9e3bc18-883f-4975-940c-930d36061d35 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.network.neutron [req-16e65ebe-1497-4a74-bcd4-48e710bcdf90 req-f9e3bc18-883f-4975-940c-930d36061d35 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-16e65ebe-1497-4a74-bcd4-48e710bcdf90 req-f9e3bc18-883f-4975-940c-930d36061d35 service nova] Releasing lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:36:39 user nova-compute[73029]: INFO nova.compute.claims [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Claim successful on node user
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully updated port: ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:36:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:36:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:36:39 user nova-compute[73029]: INFO nova.virt.block_device [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Booting with volume 206ac233-0162-487a-ae03-d7ffe340991b at /dev/vda
Aug 10 00:36:40 user nova-compute[73029]: DEBUG os_brick.utils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bc46ab-ad79-42ae-b771-6142f579853a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbabab5b-256b-4738-8838-b90dcdac80da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[202e1563-a565-40db-9b41-9da32f2c6f4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e22e8b-8022-492a-9956-7472fc24109f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:40 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfafe8e6-2e50-4e04-98f9-a65284251206]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG os_brick.utils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating existing volume attachment record: 6a22447c-34a4-4234-aeda-b41feeac226d {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG nova.policy [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53bd067c0fbe49c5a418cf218e0f685b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f4204aa7a2494c9233a97287b929da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-95da0afe-77ff-48c0-be3c-8b432bc4b548 req-aaabe47d-7901-41f2-9b95-437afc656098 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-changed-ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-95da0afe-77ff-48c0-be3c-8b432bc4b548 req-aaabe47d-7901-41f2-9b95-437afc656098 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing instance network info cache due to event network-changed-ed246d9b-d91d-40b5-b717-709f504c368d. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-95da0afe-77ff-48c0-be3c-8b432bc4b548 req-aaabe47d-7901-41f2-9b95-437afc656098 service nova] Acquiring lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-95da0afe-77ff-48c0-be3c-8b432bc4b548 req-aaabe47d-7901-41f2-9b95-437afc656098 service nova] Acquired lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG nova.network.neutron [req-95da0afe-77ff-48c0-be3c-8b432bc4b548 req-aaabe47d-7901-41f2-9b95-437afc656098 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing network info cache for port ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG nova.network.neutron [req-95da0afe-77ff-48c0-be3c-8b432bc4b548 req-aaabe47d-7901-41f2-9b95-437afc656098 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG nova.network.neutron [req-95da0afe-77ff-48c0-be3c-8b432bc4b548 req-aaabe47d-7901-41f2-9b95-437afc656098 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-95da0afe-77ff-48c0-be3c-8b432bc4b548 req-aaabe47d-7901-41f2-9b95-437afc656098 service nova] Releasing lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:41 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully updated port: 7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:41 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully created port: 8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-35a054d6-eef6-40c9-b196-833ef8c8571b req-9e06dd3b-50c3-4c8f-a928-713e69496a68 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-changed-7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-35a054d6-eef6-40c9-b196-833ef8c8571b req-9e06dd3b-50c3-4c8f-a928-713e69496a68 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing instance network info cache due to event network-changed-7828acf4-aa6f-4c50-9ef8-54badc35b15f. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-35a054d6-eef6-40c9-b196-833ef8c8571b req-9e06dd3b-50c3-4c8f-a928-713e69496a68 service nova] Acquiring lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-35a054d6-eef6-40c9-b196-833ef8c8571b req-9e06dd3b-50c3-4c8f-a928-713e69496a68 service nova] Acquired lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:42 user nova-compute[73029]: DEBUG nova.network.neutron [req-35a054d6-eef6-40c9-b196-833ef8c8571b req-9e06dd3b-50c3-4c8f-a928-713e69496a68 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing network info cache for port 7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:42 user nova-compute[73029]: DEBUG nova.network.neutron [req-35a054d6-eef6-40c9-b196-833ef8c8571b req-9e06dd3b-50c3-4c8f-a928-713e69496a68 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:43 user nova-compute[73029]: DEBUG nova.network.neutron [req-35a054d6-eef6-40c9-b196-833ef8c8571b req-9e06dd3b-50c3-4c8f-a928-713e69496a68 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-35a054d6-eef6-40c9-b196-833ef8c8571b req-9e06dd3b-50c3-4c8f-a928-713e69496a68 service nova] Releasing lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:43 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully created port: 13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:43 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully updated port: 8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-52801e7f-c359-4ccb-9913-1b315d6dcdda req-4f1c933a-6525-4cbf-9269-33ea11917406 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-changed-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-52801e7f-c359-4ccb-9913-1b315d6dcdda req-4f1c933a-6525-4cbf-9269-33ea11917406 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing instance network info cache due to event network-changed-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-52801e7f-c359-4ccb-9913-1b315d6dcdda req-4f1c933a-6525-4cbf-9269-33ea11917406 service nova] Acquiring lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-52801e7f-c359-4ccb-9913-1b315d6dcdda req-4f1c933a-6525-4cbf-9269-33ea11917406 service nova] Acquired lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:44 user nova-compute[73029]: DEBUG nova.network.neutron [req-52801e7f-c359-4ccb-9913-1b315d6dcdda req-4f1c933a-6525-4cbf-9269-33ea11917406 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing network info cache for port 8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:44 user nova-compute[73029]: DEBUG nova.network.neutron [req-52801e7f-c359-4ccb-9913-1b315d6dcdda req-4f1c933a-6525-4cbf-9269-33ea11917406 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully created port: c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:45 user nova-compute[73029]: DEBUG nova.network.neutron [req-52801e7f-c359-4ccb-9913-1b315d6dcdda req-4f1c933a-6525-4cbf-9269-33ea11917406 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-52801e7f-c359-4ccb-9913-1b315d6dcdda req-4f1c933a-6525-4cbf-9269-33ea11917406 service nova] Releasing lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully updated port: 7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully created port: 5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:46 user nova-compute[73029]: INFO nova.virt.block_device [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Booting with volume 89636026-3f23-4019-a96b-d587a5949966 at /dev/vdb
Aug 10 00:36:46 user nova-compute[73029]: DEBUG os_brick.utils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1fbd43-a60c-4c7f-9ef3-97dc2e38abc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a57328-dc4e-418c-b011-616d0aeaf810]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3a2f85-3d6a-49fa-adee-42384c20988c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f850bd-615f-4319-911f-d36b2dc49202]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-2232e5f9-53d5-467a-861a-61ead0ecba7b req-192228d8-7d18-40bd-8b32-9b5011b611bb service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-changed-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-2232e5f9-53d5-467a-861a-61ead0ecba7b req-192228d8-7d18-40bd-8b32-9b5011b611bb service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing instance network info cache due to event network-changed-7ee7c725-4d8e-4e06-a5a9-2871b750d499. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2232e5f9-53d5-467a-861a-61ead0ecba7b req-192228d8-7d18-40bd-8b32-9b5011b611bb service nova] Acquiring lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2232e5f9-53d5-467a-861a-61ead0ecba7b req-192228d8-7d18-40bd-8b32-9b5011b611bb service nova] Acquired lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG nova.network.neutron [req-2232e5f9-53d5-467a-861a-61ead0ecba7b req-192228d8-7d18-40bd-8b32-9b5011b611bb service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing network info cache for port 7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:46 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:36:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb04e1b-293d-4f41-81c3-8c9c751a5879]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG os_brick.utils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating existing volume attachment record: 6525f151-1110-4ded-977d-2776dd075017 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:36:46 user nova-compute[73029]: DEBUG nova.network.neutron [req-2232e5f9-53d5-467a-861a-61ead0ecba7b req-192228d8-7d18-40bd-8b32-9b5011b611bb service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:47 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully updated port: 014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:47 user nova-compute[73029]: DEBUG nova.network.neutron [req-2232e5f9-53d5-467a-861a-61ead0ecba7b req-192228d8-7d18-40bd-8b32-9b5011b611bb service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2232e5f9-53d5-467a-861a-61ead0ecba7b req-192228d8-7d18-40bd-8b32-9b5011b611bb service nova] Releasing lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:47 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully created port: ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:36:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-1bce8f64-8595-4720-aa46-ff9cea0c20dd req-f3684d56-d495-46c5-8a0a-1d57cee525b0 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-changed-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-1bce8f64-8595-4720-aa46-ff9cea0c20dd req-f3684d56-d495-46c5-8a0a-1d57cee525b0 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing instance network info cache due to event network-changed-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1bce8f64-8595-4720-aa46-ff9cea0c20dd req-f3684d56-d495-46c5-8a0a-1d57cee525b0 service nova] Acquiring lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1bce8f64-8595-4720-aa46-ff9cea0c20dd req-f3684d56-d495-46c5-8a0a-1d57cee525b0 service nova] Acquired lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:48 user nova-compute[73029]: DEBUG nova.network.neutron [req-1bce8f64-8595-4720-aa46-ff9cea0c20dd req-f3684d56-d495-46c5-8a0a-1d57cee525b0 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing network info cache for port 014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:48 user nova-compute[73029]: DEBUG nova.network.neutron [req-1bce8f64-8595-4720-aa46-ff9cea0c20dd req-f3684d56-d495-46c5-8a0a-1d57cee525b0 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:48 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Successfully updated port: e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG nova.network.neutron [req-1bce8f64-8595-4720-aa46-ff9cea0c20dd req-f3684d56-d495-46c5-8a0a-1d57cee525b0 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1bce8f64-8595-4720-aa46-ff9cea0c20dd req-f3684d56-d495-46c5-8a0a-1d57cee525b0 service nova] Releasing lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquired lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully updated port: 8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:49 user nova-compute[73029]: INFO nova.virt.block_device [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Booting with volume f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 at /dev/vdb
Aug 10 00:36:49 user nova-compute[73029]: DEBUG os_brick.utils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5be1de8-b345-4b51-bb79-8db718eba929]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff640d7c-1c9b-4020-829c-7cc627cf094e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba913d-1fe2-4652-bf69-d0d82cc77a1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b76ebc-f154-40fa-a213-c2d9c4c4c62d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:49 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:36:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a373ef-f5ab-4308-9678-77a7bde0ddba]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG os_brick.utils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:36:49 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating existing volume attachment record: 887b2ab2-b0e2-4d7e-876d-b4f4e0814645 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:36:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-changed-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing instance network info cache due to event network-changed-e1d1d606-7370-46f1-8249-f5868d7b0af5. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] Acquiring lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:51 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully updated port: 4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [{"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully updated port: cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Releasing lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance network_info: |[{"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] Acquired lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing network info cache for port e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-changed-4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing instance network info cache due to event network-changed-4ee226a2-f9d2-4055-8745-13664dffb75b. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] Acquiring lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] Acquired lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing network info cache for port 4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:53 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] Releasing lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-changed-cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing instance network info cache due to event network-changed-cca97791-958d-430b-9b6e-6125b2d4d28e. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] Acquiring lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] Acquired lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:53 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing network info cache for port cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:53 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updated VIF entry in instance network info cache for port e1d1d606-7370-46f1-8249-f5868d7b0af5. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [{"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] Releasing lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-changed-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing instance network info cache due to event network-changed-8ac791ec-7eb0-4442-b465-48b912df2761. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] Acquiring lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2cf4979-014e-446a-b163-ce9bc3e0ea80 req-069a52d3-53e2-4028-95f7-20728dd095b6 service nova] Releasing lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] Acquired lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing network info cache for port 8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully updated port: 13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-62151965-3ac0-4cd0-ae08-2db596084a58 req-c118abf8-77c0-41a7-992d-1c54b0d17968 service nova] Releasing lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-eedcc415-2ab6-49fd-859c-fc2d82dd9bb2 req-1fa1e428-dd20-41b8-a726-f01b432eda71 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-changed-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-eedcc415-2ab6-49fd-859c-fc2d82dd9bb2 req-1fa1e428-dd20-41b8-a726-f01b432eda71 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing instance network info cache due to event network-changed-13993caf-e057-46cb-b468-16a2ac962265. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-eedcc415-2ab6-49fd-859c-fc2d82dd9bb2 req-1fa1e428-dd20-41b8-a726-f01b432eda71 service nova] Acquiring lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-eedcc415-2ab6-49fd-859c-fc2d82dd9bb2 req-1fa1e428-dd20-41b8-a726-f01b432eda71 service nova] Acquired lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-eedcc415-2ab6-49fd-859c-fc2d82dd9bb2 req-1fa1e428-dd20-41b8-a726-f01b432eda71 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing network info cache for port 13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-eedcc415-2ab6-49fd-859c-fc2d82dd9bb2 req-1fa1e428-dd20-41b8-a726-f01b432eda71 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:55 user nova-compute[73029]: DEBUG nova.network.neutron [req-eedcc415-2ab6-49fd-859c-fc2d82dd9bb2 req-1fa1e428-dd20-41b8-a726-f01b432eda71 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-eedcc415-2ab6-49fd-859c-fc2d82dd9bb2 req-1fa1e428-dd20-41b8-a726-f01b432eda71 service nova] Releasing lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:55 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully updated port: c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:56 user nova-compute[73029]: INFO nova.virt.block_device [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Booting with volume 135a31fe-a801-459a-a536-c5fe12070507 at /dev/vdc
Aug 10 00:36:56 user nova-compute[73029]: DEBUG os_brick.utils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce646071-b30b-418e-af70-0cdeb817e32a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9f21ab-f81c-44a4-ad96-7718539770d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[063ed55e-c417-47df-8d87-db69e2e6f3e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bf626e-4a08-4fab-b0a0-7224fb33fd12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:56 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e33263-2384-4005-8c88-22e04a34fd0c]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG os_brick.utils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating existing volume attachment record: 377b9792-a230-44d0-96bc-082cbcc5e6ee {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully updated port: 5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-changed-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing instance network info cache due to event network-changed-c4677a60-3c27-4eb0-afa2-9f3d9be13600. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] Acquiring lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] Acquired lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:56 user nova-compute[73029]: DEBUG nova.network.neutron [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing network info cache for port c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] Releasing lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-changed-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing instance network info cache due to event network-changed-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] Acquiring lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] Acquired lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing network info cache for port 5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Successfully updated port: ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2c64725d-2d00-4a0e-abd2-7f497976380e req-f5966cb5-6d29-45eb-b94e-1c4ba490014c service nova] Releasing lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquired lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:36:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:36:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-c854e4cd-03f6-425d-a14d-2e870c29e534 req-e08cf69a-6eeb-43bb-afc6-706d255bae5c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-changed-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:36:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-c854e4cd-03f6-425d-a14d-2e870c29e534 req-e08cf69a-6eeb-43bb-afc6-706d255bae5c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing instance network info cache due to event network-changed-ee0d0456-d275-4932-a6ff-3de6fb281337. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:36:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c854e4cd-03f6-425d-a14d-2e870c29e534 req-e08cf69a-6eeb-43bb-afc6-706d255bae5c service nova] Acquiring lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:36:59 user nova-compute[73029]: INFO nova.virt.block_device [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Booting with volume 0cc45536-97ae-4580-b19d-9c2b447c626d at /dev/vdc
Aug 10 00:36:59 user nova-compute[73029]: DEBUG os_brick.utils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a407b38f-18f9-4b5c-a8f6-d7f7df7121ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b68d7f0-ebf6-42c4-83ec-fbbdfb5baed1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec88c7b-f5d0-403b-bb1b-173878c0f389]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afa7db1-6818-46f9-8068-66b4b24157cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:36:59 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:36:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df92bb1-ea3a-458a-ae65-8c1095236076]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG os_brick.utils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:36:59 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating existing volume attachment record: 77dfc805-d51c-45bd-81c2-50f443bc025c {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:37:00 user nova-compute[73029]: DEBUG nova.network.neutron [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [{"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Releasing lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance network_info: |[{"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:37:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c854e4cd-03f6-425d-a14d-2e870c29e534 req-e08cf69a-6eeb-43bb-afc6-706d255bae5c service nova] Acquired lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:00 user nova-compute[73029]: DEBUG nova.network.neutron [req-c854e4cd-03f6-425d-a14d-2e870c29e534 req-e08cf69a-6eeb-43bb-afc6-706d255bae5c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing network info cache for port ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:00 user nova-compute[73029]: DEBUG nova.network.neutron [req-c854e4cd-03f6-425d-a14d-2e870c29e534 req-e08cf69a-6eeb-43bb-afc6-706d255bae5c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updated VIF entry in instance network info cache for port ee0d0456-d275-4932-a6ff-3de6fb281337. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:00 user nova-compute[73029]: DEBUG nova.network.neutron [req-c854e4cd-03f6-425d-a14d-2e870c29e534 req-e08cf69a-6eeb-43bb-afc6-706d255bae5c service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [{"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c854e4cd-03f6-425d-a14d-2e870c29e534 req-e08cf69a-6eeb-43bb-afc6-706d255bae5c service nova] Releasing lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:37:05 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Creating image(s)
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Ensure instance console log exists: /opt/stack/data/nova/instances/866f4abf-6566-4145-a780-953a4615659c/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Start _get_guest_xml network_info=[{"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '971157d9-3af4-481d-932c-f460fc7011e3', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCzqpcth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '866f4abf-6566-4145-a780-953a4615659c', 'attached_at': '', 'detached_at': '', 'volume_id': '0c76b36f-3752-4309-b922-f4eb0dd8417c', 'serial': '0c76b36f-3752-4309-b922-f4eb0dd8417c'}, 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '6525f151-1110-4ded-977d-2776dd075017', 'boot_index': 1, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGvjoLda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '866f4abf-6566-4145-a780-953a4615659c', 'attached_at': '', 'detached_at': '', 'volume_id': '89636026-3f23-4019-a96b-d587a5949966', 'serial': '89636026-3f23-4019-a96b-d587a5949966'}, 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '377b9792-a230-44d0-96bc-082cbcc5e6ee', 'boot_index': 2, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcNEyJpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '866f4abf-6566-4145-a780-953a4615659c', 'attached_at': '', 'detached_at': '', 'volume_id': '135a31fe-a801-459a-a536-c5fe12070507', 'serial': '135a31fe-a801-459a-a536-c5fe12070507'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:37:05 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:05 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connector [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Factory for ISCSI on None {{(pid=73029) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCzqpcth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:05 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:05 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:05 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[761fd7ba-faee-4960-bd30-17c31965e4bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:05 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd455ce-9281-4716-84e5-f10128253a12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c] added
Aug 10 00:37:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3864df9-77b4-4781-83ca-50531758777c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cade844-0703-4366-8dfa-0fbdc47667a2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCzqpcth {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCzqpcth" returned: 0 in 0.029s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[41442ef4-3ade-4abb-a02e-c22b812d154c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aCzqpcth'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34b9093-2140-4324-aa94-3c09bc4552ae]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb71db6-21fc-400c-b900-18be0e970b48]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 00:37:05 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 00:37:05 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:05 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 00:37:05 user nova-compute[73029]: 
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fb37d9-3d8c-4506-a1ff-9e3eb5ba994c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c, portal: 172.16.0.220,3260]
Aug 10 00:37:05 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[35749bed-1fdf-4f3e-8921-c142c307359b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eedd7c3-f2a5-4f4e-802b-bbd76d8c3cf7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4161cc1c-2cee-4689-8037-50076361a6a3]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCzqpcth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23038353361343565', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038353361343565', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGvjoLda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:07 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:07 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:07 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37beb10-19b0-409b-9e95-225375340b78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:07 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2495225b-e87c-45c1-80fc-5610668668a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966] added
Aug 10 00:37:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da9ad7a-1a94-45fd-834c-0ed1568b5296]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf779d1-95b8-4191-aa4f-b39b5377286a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGvjoLda {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGvjoLda" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[387a33aa-0f09-44da-89c2-f2f611d7bf64]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gGvjoLda'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2101628e-c39a-4826-b876-42a02ebd3af0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a428ffc8-7807-4092-a720-f1bad59642dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aefc85-2225-437d-a85d-4fede257e02d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966, portal: 172.16.0.220,3260]
Aug 10 00:37:07 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82ca0cf-0944-4077-9089-fd4c517df660]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b8b0c3-9829-420c-bafc-939668542046]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:07 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:07 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[398635ce-4c5e-4fc5-8932-b6961975100a]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGvjoLda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23236636135346331', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236636135346331', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcNEyJpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:08 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:08 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:08 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf39837-e14e-4d0c-8266-dd99f6396b80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:08 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1c4cd4-9430-4a9a-a4d2-203f538c5fbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507] added
Aug 10 00:37:08 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f686e8-4c90-412e-acaa-2804b3e8bce1]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b86eab-fd0f-4dc4-8434-56c9a5069e3d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcNEyJpU {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcNEyJpU" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dc016a-d744-4d35-8370-d24b18c94ea9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tcNEyJpU'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec6d742-61bf-4d97-a432-23ce903ec153]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78ba3bd-ddc5-4378-a90d-5b7925f078b3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:08 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:08 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:08 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:08 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e5aa71-4b29-4f1f-a483-7d393aab9e9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507, portal: 172.16.0.220,3260]
Aug 10 00:37:08 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:08 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeaee41-51e0-48ac-ab9b-b5bb0311d8d7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[016fc2dc-86a9-476a-a025-48c52b37e5ad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:08 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:08 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:08 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:08 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:08 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:08 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd6050a-c231-4202-9fee-c86a5e9d71ad]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcNEyJpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23130316132383262', 'path': '/dev/sdd'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130316132383262', 'path': '/dev/sdd'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e3:f1,bridge_name='br-int',has_traffic_filtering=True,id=2fb1bff0-2a76-47ab-89c6-9463f7af33fb,network=Network(5715dc1c-60f7-4b2b-90ea-9957073f1762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fb1bff0-2a') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=ed246d9b-d91d-40b5-b717-709f504c368d,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped246d9b-d9') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=7828acf4-aa6f-4c50-9ef8-54badc35b15f,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7828acf4-aa') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:87:97,bridge_name='br-int',has_traffic_filtering=True,id=8ea3b562-0cdb-49b5-bc3d-50d6d01198bb,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3b562-0c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=7ee7c725-4d8e-4e06-a5a9-2871b750d499,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7c725-4d') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:3d:f5,bridge_name='br-int',has_traffic_filtering=True,id=014ba0f6-67f6-4eba-ad88-5cc7e48a35fd,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014ba0f6-67') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:41:8e,bridge_name='br-int',has_traffic_filtering=True,id=e1d1d606-7370-46f1-8249-f5868d7b0af5,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d1d606-73') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.objects.instance [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lazy-loading 'pci_devices' on Instance uuid 866f4abf-6566-4145-a780-953a4615659c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:37:09 user nova-compute[73029]:   <uuid>866f4abf-6566-4145-a780-953a4615659c</uuid>
Aug 10 00:37:09 user nova-compute[73029]:   <name>instance-0000000a</name>
Aug 10 00:37:09 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:37:09 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:37:09 user nova-compute[73029]:   <metadata>
Aug 10 00:37:09 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:37:09 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:37:09 user nova-compute[73029]:       <nova:name>tempest-device-tagging-server-925067125</nova:name>
Aug 10 00:37:09 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:37:05</nova:creationTime>
Aug 10 00:37:09 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:37:09 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:37:09 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:37:09 user nova-compute[73029]:       <nova:owner>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:user uuid="d037b33a7d9740d5b868298dd0551edb">tempest-TaggedBootDevicesTest_v242-1445145649-project-member</nova:user>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:project uuid="5bb0163154674b4eb8b6116b45917b53">tempest-TaggedBootDevicesTest_v242-1445145649</nova:project>
Aug 10 00:37:09 user nova-compute[73029]:       </nova:owner>
Aug 10 00:37:09 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:37:09 user nova-compute[73029]:       <nova:ports>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:port uuid="2fb1bff0-2a76-47ab-89c6-9463f7af33fb">
Aug 10 00:37:09 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 10 00:37:09 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:port uuid="ed246d9b-d91d-40b5-b717-709f504c368d">
Aug 10 00:37:09 user nova-compute[73029]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Aug 10 00:37:09 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:port uuid="7828acf4-aa6f-4c50-9ef8-54badc35b15f">
Aug 10 00:37:09 user nova-compute[73029]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Aug 10 00:37:09 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:port uuid="8ea3b562-0cdb-49b5-bc3d-50d6d01198bb">
Aug 10 00:37:09 user nova-compute[73029]:           <nova:ip type="fixed" address="10.1.1.84" ipVersion="4"/>
Aug 10 00:37:09 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:port uuid="7ee7c725-4d8e-4e06-a5a9-2871b750d499">
Aug 10 00:37:09 user nova-compute[73029]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Aug 10 00:37:09 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:port uuid="014ba0f6-67f6-4eba-ad88-5cc7e48a35fd">
Aug 10 00:37:09 user nova-compute[73029]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 10 00:37:09 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:09 user nova-compute[73029]:         <nova:port uuid="e1d1d606-7370-46f1-8249-f5868d7b0af5">
Aug 10 00:37:09 user nova-compute[73029]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 10 00:37:09 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:09 user nova-compute[73029]:       </nova:ports>
Aug 10 00:37:09 user nova-compute[73029]:     </nova:instance>
Aug 10 00:37:09 user nova-compute[73029]:   </metadata>
Aug 10 00:37:09 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:37:09 user nova-compute[73029]:     <system>
Aug 10 00:37:09 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:37:09 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:37:09 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:37:09 user nova-compute[73029]:       <entry name="serial">866f4abf-6566-4145-a780-953a4615659c</entry>
Aug 10 00:37:09 user nova-compute[73029]:       <entry name="uuid">866f4abf-6566-4145-a780-953a4615659c</entry>
Aug 10 00:37:09 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:37:09 user nova-compute[73029]:     </system>
Aug 10 00:37:09 user nova-compute[73029]:   </sysinfo>
Aug 10 00:37:09 user nova-compute[73029]:   <os>
Aug 10 00:37:09 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:37:09 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:37:09 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:37:09 user nova-compute[73029]:   </os>
Aug 10 00:37:09 user nova-compute[73029]:   <features>
Aug 10 00:37:09 user nova-compute[73029]:     <acpi/>
Aug 10 00:37:09 user nova-compute[73029]:     <apic/>
Aug 10 00:37:09 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:37:09 user nova-compute[73029]:   </features>
Aug 10 00:37:09 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:37:09 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:37:09 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:37:09 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:37:09 user nova-compute[73029]:   </clock>
Aug 10 00:37:09 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:37:09 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:37:09 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:37:09 user nova-compute[73029]:   </cpu>
Aug 10 00:37:09 user nova-compute[73029]:   <devices>
Aug 10 00:37:09 user nova-compute[73029]:     <disk type="file" device="cdrom">
Aug 10 00:37:09 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none"/>
Aug 10 00:37:09 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/866f4abf-6566-4145-a780-953a4615659c/disk.config"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="hda" bus="ide"/>
Aug 10 00:37:09 user nova-compute[73029]:     </disk>
Aug 10 00:37:09 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:37:09 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:09 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <serial>0c76b36f-3752-4309-b922-f4eb0dd8417c</serial>
Aug 10 00:37:09 user nova-compute[73029]:     </disk>
Aug 10 00:37:09 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:37:09 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:09 user nova-compute[73029]:       <source dev="/dev/sdc"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <serial>89636026-3f23-4019-a96b-d587a5949966</serial>
Aug 10 00:37:09 user nova-compute[73029]:     </disk>
Aug 10 00:37:09 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:37:09 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:09 user nova-compute[73029]:       <source dev="/dev/sdd"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="vdc" bus="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <serial>135a31fe-a801-459a-a536-c5fe12070507</serial>
Aug 10 00:37:09 user nova-compute[73029]:     </disk>
Aug 10 00:37:09 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:09 user nova-compute[73029]:       <mac address="fa:16:3e:a7:e3:f1"/>
Aug 10 00:37:09 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="tap2fb1bff0-2a"/>
Aug 10 00:37:09 user nova-compute[73029]:     </interface>
Aug 10 00:37:09 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:09 user nova-compute[73029]:       <mac address="fa:16:3e:4d:a8:43"/>
Aug 10 00:37:09 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="taped246d9b-d9"/>
Aug 10 00:37:09 user nova-compute[73029]:     </interface>
Aug 10 00:37:09 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:09 user nova-compute[73029]:       <mac address="fa:16:3e:8e:88:e0"/>
Aug 10 00:37:09 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="tap7828acf4-aa"/>
Aug 10 00:37:09 user nova-compute[73029]:     </interface>
Aug 10 00:37:09 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:09 user nova-compute[73029]:       <mac address="fa:16:3e:08:87:97"/>
Aug 10 00:37:09 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="tap8ea3b562-0c"/>
Aug 10 00:37:09 user nova-compute[73029]:     </interface>
Aug 10 00:37:09 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:09 user nova-compute[73029]:       <mac address="fa:16:3e:76:20:c6"/>
Aug 10 00:37:09 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="tap7ee7c725-4d"/>
Aug 10 00:37:09 user nova-compute[73029]:     </interface>
Aug 10 00:37:09 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:09 user nova-compute[73029]:       <mac address="fa:16:3e:75:3d:f5"/>
Aug 10 00:37:09 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="tap014ba0f6-67"/>
Aug 10 00:37:09 user nova-compute[73029]:     </interface>
Aug 10 00:37:09 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:09 user nova-compute[73029]:       <mac address="fa:16:3e:db:41:8e"/>
Aug 10 00:37:09 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:09 user nova-compute[73029]:       <target dev="tape1d1d606-73"/>
Aug 10 00:37:09 user nova-compute[73029]:     </interface>
Aug 10 00:37:09 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:37:09 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/866f4abf-6566-4145-a780-953a4615659c/console.log" append="off"/>
Aug 10 00:37:09 user nova-compute[73029]:     </serial>
Aug 10 00:37:09 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:37:09 user nova-compute[73029]:     <video>
Aug 10 00:37:09 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:09 user nova-compute[73029]:     </video>
Aug 10 00:37:09 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:37:09 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:37:09 user nova-compute[73029]:     </rng>
Aug 10 00:37:09 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:37:09 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:37:09 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:37:09 user nova-compute[73029]:     </memballoon>
Aug 10 00:37:09 user nova-compute[73029]:   </devices>
Aug 10 00:37:09 user nova-compute[73029]: </domain>
Aug 10 00:37:09 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e3:f1,bridge_name='br-int',has_traffic_filtering=True,id=2fb1bff0-2a76-47ab-89c6-9463f7af33fb,network=Network(5715dc1c-60f7-4b2b-90ea-9957073f1762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fb1bff0-2a') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e3:f1,bridge_name='br-int',has_traffic_filtering=True,id=2fb1bff0-2a76-47ab-89c6-9463f7af33fb,network=Network(5715dc1c-60f7-4b2b-90ea-9957073f1762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fb1bff0-2a') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fb1bff0-2a, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fb1bff0-2a, col_values=(('external_ids', {'iface-id': '2fb1bff0-2a76-47ab-89c6-9463f7af33fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:e3:f1', 'vm-uuid': '866f4abf-6566-4145-a780-953a4615659c'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: INFO os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e3:f1,bridge_name='br-int',has_traffic_filtering=True,id=2fb1bff0-2a76-47ab-89c6-9463f7af33fb,network=Network(5715dc1c-60f7-4b2b-90ea-9957073f1762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fb1bff0-2a')
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=ed246d9b-d91d-40b5-b717-709f504c368d,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped246d9b-d9') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=ed246d9b-d91d-40b5-b717-709f504c368d,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped246d9b-d9') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped246d9b-d9, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped246d9b-d9, col_values=(('external_ids', {'iface-id': 'ed246d9b-d91d-40b5-b717-709f504c368d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:a8:43', 'vm-uuid': '866f4abf-6566-4145-a780-953a4615659c'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: INFO os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=ed246d9b-d91d-40b5-b717-709f504c368d,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped246d9b-d9')
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=7828acf4-aa6f-4c50-9ef8-54badc35b15f,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7828acf4-aa') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=7828acf4-aa6f-4c50-9ef8-54badc35b15f,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7828acf4-aa') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7828acf4-aa, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7828acf4-aa, col_values=(('external_ids', {'iface-id': '7828acf4-aa6f-4c50-9ef8-54badc35b15f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:88:e0', 'vm-uuid': '866f4abf-6566-4145-a780-953a4615659c'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: INFO os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=7828acf4-aa6f-4c50-9ef8-54badc35b15f,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7828acf4-aa')
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:87:97,bridge_name='br-int',has_traffic_filtering=True,id=8ea3b562-0cdb-49b5-bc3d-50d6d01198bb,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3b562-0c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:87:97,bridge_name='br-int',has_traffic_filtering=True,id=8ea3b562-0cdb-49b5-bc3d-50d6d01198bb,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3b562-0c') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ea3b562-0c, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ea3b562-0c, col_values=(('external_ids', {'iface-id': '8ea3b562-0cdb-49b5-bc3d-50d6d01198bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:87:97', 'vm-uuid': '866f4abf-6566-4145-a780-953a4615659c'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: INFO os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:87:97,bridge_name='br-int',has_traffic_filtering=True,id=8ea3b562-0cdb-49b5-bc3d-50d6d01198bb,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3b562-0c')
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=7ee7c725-4d8e-4e06-a5a9-2871b750d499,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7c725-4d') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=7ee7c725-4d8e-4e06-a5a9-2871b750d499,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7c725-4d') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ee7c725-4d, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ee7c725-4d, col_values=(('external_ids', {'iface-id': '7ee7c725-4d8e-4e06-a5a9-2871b750d499', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:20:c6', 'vm-uuid': '866f4abf-6566-4145-a780-953a4615659c'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: INFO os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=7ee7c725-4d8e-4e06-a5a9-2871b750d499,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7c725-4d')
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:3d:f5,bridge_name='br-int',has_traffic_filtering=True,id=014ba0f6-67f6-4eba-ad88-5cc7e48a35fd,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014ba0f6-67') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:3d:f5,bridge_name='br-int',has_traffic_filtering=True,id=014ba0f6-67f6-4eba-ad88-5cc7e48a35fd,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014ba0f6-67') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap014ba0f6-67, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap014ba0f6-67, col_values=(('external_ids', {'iface-id': '014ba0f6-67f6-4eba-ad88-5cc7e48a35fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:3d:f5', 'vm-uuid': '866f4abf-6566-4145-a780-953a4615659c'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:10 user nova-compute[73029]: INFO os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:3d:f5,bridge_name='br-int',has_traffic_filtering=True,id=014ba0f6-67f6-4eba-ad88-5cc7e48a35fd,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014ba0f6-67')
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:41:8e,bridge_name='br-int',has_traffic_filtering=True,id=e1d1d606-7370-46f1-8249-f5868d7b0af5,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d1d606-73') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:41:8e,bridge_name='br-int',has_traffic_filtering=True,id=e1d1d606-7370-46f1-8249-f5868d7b0af5,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d1d606-73') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1d1d606-73, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1d1d606-73, col_values=(('external_ids', {'iface-id': 'e1d1d606-7370-46f1-8249-f5868d7b0af5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:41:8e', 'vm-uuid': '866f4abf-6566-4145-a780-953a4615659c'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:10 user nova-compute[73029]: INFO os_vif [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:41:8e,bridge_name='br-int',has_traffic_filtering=True,id=e1d1d606-7370-46f1-8249-f5868d7b0af5,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d1d606-73')
Aug 10 00:37:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] No BDM found with device name hda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] No VIF found with MAC fa:16:3e:a7:e3:f1, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] No VIF found with MAC fa:16:3e:76:20:c6, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:10 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Using config drive
Aug 10 00:37:10 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Creating config drive at /opt/stack/data/nova/instances/866f4abf-6566-4145-a780-953a4615659c/disk.config
Aug 10 00:37:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/866f4abf-6566-4145-a780-953a4615659c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpafkp90uk {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/866f4abf-6566-4145-a780-953a4615659c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpafkp90uk" returned: 0 in 0.055s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating instance_info_cache with network_info: [{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:37:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-c5acf18a-cbb4-4ba0-9581-9dca5eacc633 req-5a1a6b9d-fbab-4c01-973e-cbfacb6ae630 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c5acf18a-cbb4-4ba0-9581-9dca5eacc633 req-5a1a6b9d-fbab-4c01-973e-cbfacb6ae630 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c5acf18a-cbb4-4ba0-9581-9dca5eacc633 req-5a1a6b9d-fbab-4c01-973e-cbfacb6ae630 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c5acf18a-cbb4-4ba0-9581-9dca5eacc633 req-5a1a6b9d-fbab-4c01-973e-cbfacb6ae630 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-c5acf18a-cbb4-4ba0-9581-9dca5eacc633 req-5a1a6b9d-fbab-4c01-973e-cbfacb6ae630 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:12 user nova-compute[73029]: WARNING nova.compute.manager [req-c5acf18a-cbb4-4ba0-9581-9dca5eacc633 req-5a1a6b9d-fbab-4c01-973e-cbfacb6ae630 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb for instance with vm_state building and task_state spawning.
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-dc6aa8eb-8fe8-4577-a7a1-77daddbb2502 req-af255ea6-edcd-4e9d-9411-5001f0fda850 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-dc6aa8eb-8fe8-4577-a7a1-77daddbb2502 req-af255ea6-edcd-4e9d-9411-5001f0fda850 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-dc6aa8eb-8fe8-4577-a7a1-77daddbb2502 req-af255ea6-edcd-4e9d-9411-5001f0fda850 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-dc6aa8eb-8fe8-4577-a7a1-77daddbb2502 req-af255ea6-edcd-4e9d-9411-5001f0fda850 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-dc6aa8eb-8fe8-4577-a7a1-77daddbb2502 req-af255ea6-edcd-4e9d-9411-5001f0fda850 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:12 user nova-compute[73029]: WARNING nova.compute.manager [req-dc6aa8eb-8fe8-4577-a7a1-77daddbb2502 req-af255ea6-edcd-4e9d-9411-5001f0fda850 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-ed246d9b-d91d-40b5-b717-709f504c368d for instance with vm_state building and task_state spawning.
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-e17ae146-5faf-4ba4-a9f5-282d3023e438 req-b8a93c9d-4f3d-4c05-a6f2-47ba2e821abe service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-ed246d9b-d91d-40b5-b717-709f504c368d for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:14 user nova-compute[73029]: WARNING nova.compute.manager [req-6a6913a1-6ea6-4a68-befe-ca84ec78112b req-42b3e564-1f1c-4809-830c-c502f4a3a90a service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 for instance with vm_state building and task_state spawning.
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627836.187515, 866f4abf-6566-4145-a780-953a4615659c => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:37:16 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 866f4abf-6566-4145-a780-953a4615659c] VM Resumed (Lifecycle Event)
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:37:16 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance spawned successfully.
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 866f4abf-6566-4145-a780-953a4615659c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 866f4abf-6566-4145-a780-953a4615659c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:16 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 866f4abf-6566-4145-a780-953a4615659c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627836.199273, 866f4abf-6566-4145-a780-953a4615659c => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:37:16 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 866f4abf-6566-4145-a780-953a4615659c] VM Started (Lifecycle Event)
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 866f4abf-6566-4145-a780-953a4615659c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 866f4abf-6566-4145-a780-953a4615659c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-6f5f3b88-1ad0-4373-93e6-cf07f659f24f req-c8d83f71-e5ac-4ccd-b1fb-42435c901e5c service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-changed-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-6f5f3b88-1ad0-4373-93e6-cf07f659f24f req-c8d83f71-e5ac-4ccd-b1fb-42435c901e5c service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Refreshing instance network info cache due to event network-changed-756092b1-bc75-4163-a66c-ecaff9bcb39d. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6f5f3b88-1ad0-4373-93e6-cf07f659f24f req-c8d83f71-e5ac-4ccd-b1fb-42435c901e5c service nova] Acquiring lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6f5f3b88-1ad0-4373-93e6-cf07f659f24f req-c8d83f71-e5ac-4ccd-b1fb-42435c901e5c service nova] Acquired lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.network.neutron [req-6f5f3b88-1ad0-4373-93e6-cf07f659f24f req-c8d83f71-e5ac-4ccd-b1fb-42435c901e5c service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Refreshing network info cache for port 756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:16 user nova-compute[73029]: INFO nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Took 10.73 seconds to spawn the instance on the hypervisor.
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:16 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 866f4abf-6566-4145-a780-953a4615659c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:16 user nova-compute[73029]: INFO nova.compute.manager [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Took 42.88 seconds to build instance.
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-019dcda5-f88e-4758-93fa-90ff3ebd1ec0 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "866f4abf-6566-4145-a780-953a4615659c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.990s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-17c16481-3097-4322-bb2f-e0283ea491a2 req-72b2ce5d-20cc-4ef3-a91f-581a725c13ef service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-17c16481-3097-4322-bb2f-e0283ea491a2 req-72b2ce5d-20cc-4ef3-a91f-581a725c13ef service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-17c16481-3097-4322-bb2f-e0283ea491a2 req-72b2ce5d-20cc-4ef3-a91f-581a725c13ef service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-17c16481-3097-4322-bb2f-e0283ea491a2 req-72b2ce5d-20cc-4ef3-a91f-581a725c13ef service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-17c16481-3097-4322-bb2f-e0283ea491a2 req-72b2ce5d-20cc-4ef3-a91f-581a725c13ef service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:16 user nova-compute[73029]: WARNING nova.compute.manager [req-17c16481-3097-4322-bb2f-e0283ea491a2 req-72b2ce5d-20cc-4ef3-a91f-581a725c13ef service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 for instance with vm_state active and task_state None.
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG nova.network.neutron [req-6f5f3b88-1ad0-4373-93e6-cf07f659f24f req-c8d83f71-e5ac-4ccd-b1fb-42435c901e5c service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updated VIF entry in instance network info cache for port 756092b1-bc75-4163-a66c-ecaff9bcb39d. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG nova.network.neutron [req-6f5f3b88-1ad0-4373-93e6-cf07f659f24f req-c8d83f71-e5ac-4ccd-b1fb-42435c901e5c service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating instance_info_cache with network_info: [{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6f5f3b88-1ad0-4373-93e6-cf07f659f24f req-c8d83f71-e5ac-4ccd-b1fb-42435c901e5c service nova] Releasing lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:18 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:18 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=6876MB free_disk=25.458580017089844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.objects.instance [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lazy-loading 'flavor' on Instance uuid 0012ccc2-0fdf-4bdc-84c7-be4279032bdd {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 0012ccc2-0fdf-4bdc-84c7-be4279032bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 118963ea-d3cf-4c10-945f-4718a02412c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 68b798ae-944c-40f4-9747-79d60e9bf6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 37790055-25a9-4304-891e-17ccd8b0f46d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 866f4abf-6566-4145-a780-953a4615659c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cc846d6c-027a-4a9a-819f-27919f3d2b25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-7a0fc58b-40b8-4919-a17a-8579c63abde5 req-f7c626b7-fb9a-436b-9268-c67a36298552 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-changed-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-7a0fc58b-40b8-4919-a17a-8579c63abde5 req-f7c626b7-fb9a-436b-9268-c67a36298552 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Refreshing instance network info cache due to event network-changed-ce93d51f-3ef0-48a2-b705-1a2d12fcccac. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7a0fc58b-40b8-4919-a17a-8579c63abde5 req-f7c626b7-fb9a-436b-9268-c67a36298552 service nova] Acquiring lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7a0fc58b-40b8-4919-a17a-8579c63abde5 req-f7c626b7-fb9a-436b-9268-c67a36298552 service nova] Acquired lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.network.neutron [req-7a0fc58b-40b8-4919-a17a-8579c63abde5 req-f7c626b7-fb9a-436b-9268-c67a36298552 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Refreshing network info cache for port ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:18 user nova-compute[73029]: INFO nova.compute.manager [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Attaching volume 1960c40a-9aad-4c7a-97a3-112d4c36cd83 to /dev/vdb
Aug 10 00:37:18 user nova-compute[73029]: DEBUG os_brick.utils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0436c5bc-b235-4deb-9b6c-d317b618e2b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67793ac-1742-4802-91ad-2ceb96551dd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d42d5c6-7fa4-47ea-9b8a-7c6071456c01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[258acdf1-fd17-433f-b499-c0506660bd4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.681s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:18 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:37:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[97520d9e-1b20-4e6b-8ffd-438c6e545f28]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG os_brick.utils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:18 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Updating existing volume attachment record: ff0d4c84-c53b-4236-b040-3d8eef2f68f9 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-7a0fc58b-40b8-4919-a17a-8579c63abde5 req-f7c626b7-fb9a-436b-9268-c67a36298552 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updated VIF entry in instance network info cache for port ce93d51f-3ef0-48a2-b705-1a2d12fcccac. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-7a0fc58b-40b8-4919-a17a-8579c63abde5 req-f7c626b7-fb9a-436b-9268-c67a36298552 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating instance_info_cache with network_info: [{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7a0fc58b-40b8-4919-a17a-8579c63abde5 req-f7c626b7-fb9a-436b-9268-c67a36298552 service nova] Releasing lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:19 user nova-compute[73029]: INFO nova.compute.manager [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] instance snapshotting
Aug 10 00:37:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Beginning live snapshot process
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json -f qcow2 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json -f qcow2" returned: 0 in 0.155s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json -f qcow2 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json -f qcow2" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmk4zys4p/5f0017d3520149d8b2378ec7f0ba7ec9.delta 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:37:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Creating image(s)
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Ensure instance console log exists: /opt/stack/data/nova/instances/cc846d6c-027a-4a9a-819f-27919f3d2b25/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Start _get_guest_xml network_info=[{"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '6a22447c-34a4-4234-aeda-b41feeac226d', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWLBxCbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc846d6c-027a-4a9a-819f-27919f3d2b25', 'attached_at': '', 'detached_at': '', 'volume_id': '206ac233-0162-487a-ae03-d7ffe340991b', 'serial': '206ac233-0162-487a-ae03-d7ffe340991b'}, 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '887b2ab2-b0e2-4d7e-876d-b4f4e0814645', 'boot_index': 1, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAeMJwBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc846d6c-027a-4a9a-819f-27919f3d2b25', 'attached_at': '', 'detached_at': '', 'volume_id': 'f93fbaad-1f39-4dc2-8df3-2bfe5db12f71', 'serial': 'f93fbaad-1f39-4dc2-8df3-2bfe5db12f71'}, 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '77dfc805-d51c-45bd-81c2-50f443bc025c', 'boot_index': 2, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pABbxQGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc846d6c-027a-4a9a-819f-27919f3d2b25', 'attached_at': '', 'detached_at': '', 'volume_id': '0cc45536-97ae-4580-b19d-9c2b447c626d', 'serial': '0cc45536-97ae-4580-b19d-9c2b447c626d'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmk4zys4p/5f0017d3520149d8b2378ec7f0ba7ec9.delta 1073741824" returned: 0 in 0.092s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 10 00:37:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73029) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 10 00:37:19 user nova-compute[73029]: INFO nova.virt.libvirt.host [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] UEFI support detected
Aug 10 00:37:20 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:20 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWLBxCbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:20 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:20 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:20 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb39dd2-267c-48ab-aa6b-7b36291fccbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:20 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee76fe3-cf9f-4638-96ef-844817746ef1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b] added
Aug 10 00:37:20 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adda973-0fdd-47f1-82ba-bec875421e97]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[174f33c1-2f3d-4e3f-b30e-9c2fb605cf44]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWLBxCbP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWLBxCbP" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67d6dac-e43e-4250-9c77-570bd3215706]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hWLBxCbP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[948e43f6-86fc-4cef-b47b-c0614a58c19f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1524ad-bb64-4ef4-aac8-ecb1f3a01e86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:20 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:20 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[be95f9a7-cb1f-4337-90fd-bf369a0a33c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b, portal: 172.16.0.220,3260]
Aug 10 00:37:20 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:20 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca65ee78-0c2c-4c26-80d8-3b145dbfcdb7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d60c2c-ce1c-4388-aa2f-3fcf406f79bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:20 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:20 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:20 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.061s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[26978132-2207-4910-adb0-aacef35211f2]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWLBxCbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-b7b92aeb-56ff-4705-ae1f-6e510885f813 req-070d3032-7669-4077-8077-c95b590dde5b service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received event network-changed-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-b7b92aeb-56ff-4705-ae1f-6e510885f813 req-070d3032-7669-4077-8077-c95b590dde5b service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Refreshing instance network info cache due to event network-changed-fdf2d6d9-ffa0-4264-9bef-d602571f44e4. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7b92aeb-56ff-4705-ae1f-6e510885f813 req-070d3032-7669-4077-8077-c95b590dde5b service nova] Acquiring lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7b92aeb-56ff-4705-ae1f-6e510885f813 req-070d3032-7669-4077-8077-c95b590dde5b service nova] Acquired lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:20 user nova-compute[73029]: DEBUG nova.network.neutron [req-b7b92aeb-56ff-4705-ae1f-6e510885f813 req-070d3032-7669-4077-8077-c95b590dde5b service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Refreshing network info cache for port fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26562626464373736', 'path': '/dev/sde'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562626464373736', 'path': '/dev/sde'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] COPY block job progress, current cursor: 17301504 final cursor: 75497472 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAeMJwBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.017s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:21 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4c0625-59be-41fa-8822-75f779df47b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:21 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a20f4-4e8a-4a23-a120-6ccf962b11c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71] added
Aug 10 00:37:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db4150-74cd-40fa-a541-4d3e36184d01]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[059ea60a-77ad-4606-b821-efc04dc64aeb]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zAeMJwBt {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zAeMJwBt" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9952e252-7533-434f-b7d7-559fc9af4377]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zAeMJwBt'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22038ed-4f45-4fbc-a361-1c19e31e64be]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eab60e2-7925-46a6-9449-3863fa153553]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:21 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:21 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:21 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:21 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:21 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:21 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-b7b92aeb-56ff-4705-ae1f-6e510885f813 req-070d3032-7669-4077-8077-c95b590dde5b service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Updated VIF entry in instance network info cache for port fdf2d6d9-ffa0-4264-9bef-d602571f44e4. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-b7b92aeb-56ff-4705-ae1f-6e510885f813 req-070d3032-7669-4077-8077-c95b590dde5b service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Updating instance_info_cache with network_info: [{"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7b92aeb-56ff-4705-ae1f-6e510885f813 req-070d3032-7669-4077-8077-c95b590dde5b service nova] Releasing lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1f4a98-3d6b-4f32-92a0-31ffe661e82d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71, portal: 172.16.0.220,3260]
Aug 10 00:37:21 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[57579707-5e8f-4781-bcc0-5842bba1af15]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[920f4d5f-e6bd-4df0-9edd-3b65e9ef0bf4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:22 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:22 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:22 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:22 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:22 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:22 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:22 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:22 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[000eb065-0885-4845-be33-7d80296711f0]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAeMJwBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:37:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 10 00:37:22 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmk4zys4p/5f0017d3520149d8b2378ec7f0ba7ec9.delta /opt/stack/data/nova/instances/snapshots/tmpmk4zys4p/5f0017d3520149d8b2378ec7f0ba7ec9 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmk4zys4p/5f0017d3520149d8b2378ec7f0ba7ec9.delta /opt/stack/data/nova/instances/snapshots/tmpmk4zys4p/5f0017d3520149d8b2378ec7f0ba7ec9" returned: 0 in 0.472s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Snapshot extracted, beginning image upload
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23231303939393930', 'path': '/dev/sdf'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231303939393930', 'path': '/dev/sdf'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pABbxQGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:23 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:23 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:23 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5568cc-3c20-4e2e-be6f-986a6cc17a66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:23 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d86b3b7-7dd6-4c35-a0f7-3ba725e030df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d] added
Aug 10 00:37:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7998f9d-1c77-45e9-a3bd-b4cb51599e3f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a90e57-2376-48ca-b526-9150bdb3ef04]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pABbxQGu {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pABbxQGu" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b2a148-6533-4aa5-9f45-c7a0d1dc816a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pABbxQGu'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aef335-c4f5-4147-9996-d4b0d77242ca]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdcb422-887a-4b1a-a842-5b933e184cf1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a631d2a-5e9e-4457-8f83-f89342780191]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d, portal: 172.16.0.220,3260]
Aug 10 00:37:23 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e54d0-7121-4743-a9c7-61c77878c218]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e51d3a-8173-42e0-8238-e4fb6cf4760d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:23 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a93e73-8233-4389-9760-f58ec7545a05]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pABbxQGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23839386564373865', 'path': '/dev/sdg'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839386564373865', 'path': '/dev/sdg'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:33:d0,bridge_name='br-int',has_traffic_filtering=True,id=8ac791ec-7eb0-4442-b465-48b912df2761,network=Network(d0c95518-35b2-47e1-af90-e735f38ac458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac791ec-7e') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:76:4e,bridge_name='br-int',has_traffic_filtering=True,id=4ee226a2-f9d2-4055-8745-13664dffb75b,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ee226a2-f9') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:46:e7,bridge_name='br-int',has_traffic_filtering=True,id=cca97791-958d-430b-9b6e-6125b2d4d28e,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcca97791-95') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=13993caf-e057-46cb-b468-16a2ac962265,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13993caf-e0') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:66,bridge_name='br-int',has_traffic_filtering=True,id=c4677a60-3c27-4eb0-afa2-9f3d9be13600,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4677a60-3c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=5cdd5d6a-c5a5-491f-8dc9-f0494a413de5,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdd5d6a-c5') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:07:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee0d0456-d275-4932-a6ff-3de6fb281337,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0d0456-d2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.objects.instance [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lazy-loading 'pci_devices' on Instance uuid cc846d6c-027a-4a9a-819f-27919f3d2b25 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:37:24 user nova-compute[73029]:   <uuid>cc846d6c-027a-4a9a-819f-27919f3d2b25</uuid>
Aug 10 00:37:24 user nova-compute[73029]:   <name>instance-0000000b</name>
Aug 10 00:37:24 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:37:24 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:37:24 user nova-compute[73029]:   <metadata>
Aug 10 00:37:24 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:37:24 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:37:24 user nova-compute[73029]:       <nova:name>tempest-device-tagging-server-988791272</nova:name>
Aug 10 00:37:24 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:37:20</nova:creationTime>
Aug 10 00:37:24 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:37:24 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:37:24 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:37:24 user nova-compute[73029]:       <nova:owner>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:user uuid="53bd067c0fbe49c5a418cf218e0f685b">tempest-TaggedBootDevicesTest-417793474-project-member</nova:user>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:project uuid="f2f4204aa7a2494c9233a97287b929da">tempest-TaggedBootDevicesTest-417793474</nova:project>
Aug 10 00:37:24 user nova-compute[73029]:       </nova:owner>
Aug 10 00:37:24 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:37:24 user nova-compute[73029]:       <nova:ports>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:port uuid="8ac791ec-7eb0-4442-b465-48b912df2761">
Aug 10 00:37:24 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 10 00:37:24 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:port uuid="4ee226a2-f9d2-4055-8745-13664dffb75b">
Aug 10 00:37:24 user nova-compute[73029]:           <nova:ip type="fixed" address="10.1.1.213" ipVersion="4"/>
Aug 10 00:37:24 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:port uuid="cca97791-958d-430b-9b6e-6125b2d4d28e">
Aug 10 00:37:24 user nova-compute[73029]:           <nova:ip type="fixed" address="10.1.1.196" ipVersion="4"/>
Aug 10 00:37:24 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:port uuid="13993caf-e057-46cb-b468-16a2ac962265">
Aug 10 00:37:24 user nova-compute[73029]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Aug 10 00:37:24 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:port uuid="c4677a60-3c27-4eb0-afa2-9f3d9be13600">
Aug 10 00:37:24 user nova-compute[73029]:           <nova:ip type="fixed" address="10.1.1.45" ipVersion="4"/>
Aug 10 00:37:24 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:port uuid="5cdd5d6a-c5a5-491f-8dc9-f0494a413de5">
Aug 10 00:37:24 user nova-compute[73029]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 10 00:37:24 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:24 user nova-compute[73029]:         <nova:port uuid="ee0d0456-d275-4932-a6ff-3de6fb281337">
Aug 10 00:37:24 user nova-compute[73029]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 10 00:37:24 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:24 user nova-compute[73029]:       </nova:ports>
Aug 10 00:37:24 user nova-compute[73029]:     </nova:instance>
Aug 10 00:37:24 user nova-compute[73029]:   </metadata>
Aug 10 00:37:24 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:37:24 user nova-compute[73029]:     <system>
Aug 10 00:37:24 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:37:24 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:37:24 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:37:24 user nova-compute[73029]:       <entry name="serial">cc846d6c-027a-4a9a-819f-27919f3d2b25</entry>
Aug 10 00:37:24 user nova-compute[73029]:       <entry name="uuid">cc846d6c-027a-4a9a-819f-27919f3d2b25</entry>
Aug 10 00:37:24 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:37:24 user nova-compute[73029]:     </system>
Aug 10 00:37:24 user nova-compute[73029]:   </sysinfo>
Aug 10 00:37:24 user nova-compute[73029]:   <os>
Aug 10 00:37:24 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:37:24 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:37:24 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:37:24 user nova-compute[73029]:   </os>
Aug 10 00:37:24 user nova-compute[73029]:   <features>
Aug 10 00:37:24 user nova-compute[73029]:     <acpi/>
Aug 10 00:37:24 user nova-compute[73029]:     <apic/>
Aug 10 00:37:24 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:37:24 user nova-compute[73029]:   </features>
Aug 10 00:37:24 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:37:24 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:37:24 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:37:24 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:37:24 user nova-compute[73029]:   </clock>
Aug 10 00:37:24 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:37:24 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:37:24 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:37:24 user nova-compute[73029]:   </cpu>
Aug 10 00:37:24 user nova-compute[73029]:   <devices>
Aug 10 00:37:24 user nova-compute[73029]:     <disk type="file" device="cdrom">
Aug 10 00:37:24 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none"/>
Aug 10 00:37:24 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/cc846d6c-027a-4a9a-819f-27919f3d2b25/disk.config"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="hda" bus="ide"/>
Aug 10 00:37:24 user nova-compute[73029]:     </disk>
Aug 10 00:37:24 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:37:24 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:24 user nova-compute[73029]:       <source dev="/dev/sde"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <serial>206ac233-0162-487a-ae03-d7ffe340991b</serial>
Aug 10 00:37:24 user nova-compute[73029]:     </disk>
Aug 10 00:37:24 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:37:24 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:24 user nova-compute[73029]:       <source dev="/dev/sdf"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <serial>f93fbaad-1f39-4dc2-8df3-2bfe5db12f71</serial>
Aug 10 00:37:24 user nova-compute[73029]:     </disk>
Aug 10 00:37:24 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:37:24 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:24 user nova-compute[73029]:       <source dev="/dev/sdg"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="vdc" bus="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <serial>0cc45536-97ae-4580-b19d-9c2b447c626d</serial>
Aug 10 00:37:24 user nova-compute[73029]:     </disk>
Aug 10 00:37:24 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:24 user nova-compute[73029]:       <mac address="fa:16:3e:7b:33:d0"/>
Aug 10 00:37:24 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="tap8ac791ec-7e"/>
Aug 10 00:37:24 user nova-compute[73029]:     </interface>
Aug 10 00:37:24 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:24 user nova-compute[73029]:       <mac address="fa:16:3e:13:76:4e"/>
Aug 10 00:37:24 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="tap4ee226a2-f9"/>
Aug 10 00:37:24 user nova-compute[73029]:     </interface>
Aug 10 00:37:24 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:24 user nova-compute[73029]:       <mac address="fa:16:3e:72:46:e7"/>
Aug 10 00:37:24 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="tapcca97791-95"/>
Aug 10 00:37:24 user nova-compute[73029]:     </interface>
Aug 10 00:37:24 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:24 user nova-compute[73029]:       <mac address="fa:16:3e:d8:b4:54"/>
Aug 10 00:37:24 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="tap13993caf-e0"/>
Aug 10 00:37:24 user nova-compute[73029]:     </interface>
Aug 10 00:37:24 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:24 user nova-compute[73029]:       <mac address="fa:16:3e:13:d3:66"/>
Aug 10 00:37:24 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="tapc4677a60-3c"/>
Aug 10 00:37:24 user nova-compute[73029]:     </interface>
Aug 10 00:37:24 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:24 user nova-compute[73029]:       <mac address="fa:16:3e:80:69:f8"/>
Aug 10 00:37:24 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="tap5cdd5d6a-c5"/>
Aug 10 00:37:24 user nova-compute[73029]:     </interface>
Aug 10 00:37:24 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:24 user nova-compute[73029]:       <mac address="fa:16:3e:01:07:a7"/>
Aug 10 00:37:24 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:24 user nova-compute[73029]:       <target dev="tapee0d0456-d2"/>
Aug 10 00:37:24 user nova-compute[73029]:     </interface>
Aug 10 00:37:24 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:37:24 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/cc846d6c-027a-4a9a-819f-27919f3d2b25/console.log" append="off"/>
Aug 10 00:37:24 user nova-compute[73029]:     </serial>
Aug 10 00:37:24 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:37:24 user nova-compute[73029]:     <video>
Aug 10 00:37:24 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:24 user nova-compute[73029]:     </video>
Aug 10 00:37:24 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:37:24 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:37:24 user nova-compute[73029]:     </rng>
Aug 10 00:37:24 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:37:24 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:37:24 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:37:24 user nova-compute[73029]:     </memballoon>
Aug 10 00:37:24 user nova-compute[73029]:   </devices>
Aug 10 00:37:24 user nova-compute[73029]: </domain>
Aug 10 00:37:24 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:33:d0,bridge_name='br-int',has_traffic_filtering=True,id=8ac791ec-7eb0-4442-b465-48b912df2761,network=Network(d0c95518-35b2-47e1-af90-e735f38ac458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac791ec-7e') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:33:d0,bridge_name='br-int',has_traffic_filtering=True,id=8ac791ec-7eb0-4442-b465-48b912df2761,network=Network(d0c95518-35b2-47e1-af90-e735f38ac458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac791ec-7e') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ac791ec-7e, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ac791ec-7e, col_values=(('external_ids', {'iface-id': '8ac791ec-7eb0-4442-b465-48b912df2761', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:33:d0', 'vm-uuid': 'cc846d6c-027a-4a9a-819f-27919f3d2b25'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: INFO os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:33:d0,bridge_name='br-int',has_traffic_filtering=True,id=8ac791ec-7eb0-4442-b465-48b912df2761,network=Network(d0c95518-35b2-47e1-af90-e735f38ac458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac791ec-7e')
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:76:4e,bridge_name='br-int',has_traffic_filtering=True,id=4ee226a2-f9d2-4055-8745-13664dffb75b,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ee226a2-f9') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:76:4e,bridge_name='br-int',has_traffic_filtering=True,id=4ee226a2-f9d2-4055-8745-13664dffb75b,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ee226a2-f9') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ee226a2-f9, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ee226a2-f9, col_values=(('external_ids', {'iface-id': '4ee226a2-f9d2-4055-8745-13664dffb75b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:76:4e', 'vm-uuid': 'cc846d6c-027a-4a9a-819f-27919f3d2b25'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: INFO os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:76:4e,bridge_name='br-int',has_traffic_filtering=True,id=4ee226a2-f9d2-4055-8745-13664dffb75b,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ee226a2-f9')
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:46:e7,bridge_name='br-int',has_traffic_filtering=True,id=cca97791-958d-430b-9b6e-6125b2d4d28e,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcca97791-95') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:46:e7,bridge_name='br-int',has_traffic_filtering=True,id=cca97791-958d-430b-9b6e-6125b2d4d28e,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcca97791-95') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcca97791-95, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcca97791-95, col_values=(('external_ids', {'iface-id': 'cca97791-958d-430b-9b6e-6125b2d4d28e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:46:e7', 'vm-uuid': 'cc846d6c-027a-4a9a-819f-27919f3d2b25'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: INFO os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:46:e7,bridge_name='br-int',has_traffic_filtering=True,id=cca97791-958d-430b-9b6e-6125b2d4d28e,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcca97791-95')
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=13993caf-e057-46cb-b468-16a2ac962265,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13993caf-e0') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=13993caf-e057-46cb-b468-16a2ac962265,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13993caf-e0') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13993caf-e0, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13993caf-e0, col_values=(('external_ids', {'iface-id': '13993caf-e057-46cb-b468-16a2ac962265', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:b4:54', 'vm-uuid': 'cc846d6c-027a-4a9a-819f-27919f3d2b25'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: INFO os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=13993caf-e057-46cb-b468-16a2ac962265,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13993caf-e0')
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:66,bridge_name='br-int',has_traffic_filtering=True,id=c4677a60-3c27-4eb0-afa2-9f3d9be13600,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4677a60-3c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:66,bridge_name='br-int',has_traffic_filtering=True,id=c4677a60-3c27-4eb0-afa2-9f3d9be13600,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4677a60-3c') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4677a60-3c, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4677a60-3c, col_values=(('external_ids', {'iface-id': 'c4677a60-3c27-4eb0-afa2-9f3d9be13600', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:d3:66', 'vm-uuid': 'cc846d6c-027a-4a9a-819f-27919f3d2b25'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: INFO os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:66,bridge_name='br-int',has_traffic_filtering=True,id=c4677a60-3c27-4eb0-afa2-9f3d9be13600,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4677a60-3c')
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=5cdd5d6a-c5a5-491f-8dc9-f0494a413de5,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdd5d6a-c5') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=5cdd5d6a-c5a5-491f-8dc9-f0494a413de5,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdd5d6a-c5') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cdd5d6a-c5, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cdd5d6a-c5, col_values=(('external_ids', {'iface-id': '5cdd5d6a-c5a5-491f-8dc9-f0494a413de5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:69:f8', 'vm-uuid': 'cc846d6c-027a-4a9a-819f-27919f3d2b25'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:25 user nova-compute[73029]: INFO os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=5cdd5d6a-c5a5-491f-8dc9-f0494a413de5,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdd5d6a-c5')
Aug 10 00:37:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:07:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee0d0456-d275-4932-a6ff-3de6fb281337,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0d0456-d2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:07:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee0d0456-d275-4932-a6ff-3de6fb281337,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0d0456-d2') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee0d0456-d2, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee0d0456-d2, col_values=(('external_ids', {'iface-id': 'ee0d0456-d275-4932-a6ff-3de6fb281337', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:07:a7', 'vm-uuid': 'cc846d6c-027a-4a9a-819f-27919f3d2b25'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:25 user nova-compute[73029]: INFO os_vif [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:07:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee0d0456-d275-4932-a6ff-3de6fb281337,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0d0456-d2')
Aug 10 00:37:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] No BDM found with device name hda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] No VIF found with MAC fa:16:3e:7b:33:d0, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] No VIF found with MAC fa:16:3e:13:d3:66, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Using config drive
Aug 10 00:37:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Creating config drive at /opt/stack/data/nova/instances/cc846d6c-027a-4a9a-819f-27919f3d2b25/disk.config
Aug 10 00:37:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cc846d6c-027a-4a9a-819f-27919f3d2b25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp086zxnbf {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cc846d6c-027a-4a9a-819f-27919f3d2b25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp086zxnbf" returned: 0 in 0.057s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Snapshot image upload complete
Aug 10 00:37:25 user nova-compute[73029]: INFO nova.compute.manager [None req-176564e7-8e3a-42db-86e6-befc7fad8dc8 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Took 6.84 seconds to snapshot the instance on the hypervisor.
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'flavor' on Instance uuid aa5be433-9c8a-4e52-b61d-15a84f188cc3 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:26 user nova-compute[73029]: INFO nova.compute.manager [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Attaching volume 7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 to /dev/vdb
Aug 10 00:37:26 user nova-compute[73029]: DEBUG os_brick.utils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2067ca4-7288-425a-84d8-a12efb0fe096]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c25677-a00b-4d19-9903-60e295128fe5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d2f47e-277d-4f54-80c6-4b00c6351bb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[59123ba1-a338-41aa-8ba4-5309a4757e31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:26 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:37:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc6ad16-6ee0-444f-b165-a2d865c7d49e]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG os_brick.utils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:26 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Updating existing volume attachment record: 84ec7d07-cddb-48a1-a1bf-99aa2ddebe3b {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-4b40a169-8274-4c12-8c72-993665bfc18d req-f2d75ec9-0f07-4c24-8ec1-6d5a2d8b1843 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4b40a169-8274-4c12-8c72-993665bfc18d req-f2d75ec9-0f07-4c24-8ec1-6d5a2d8b1843 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4b40a169-8274-4c12-8c72-993665bfc18d req-f2d75ec9-0f07-4c24-8ec1-6d5a2d8b1843 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4b40a169-8274-4c12-8c72-993665bfc18d req-f2d75ec9-0f07-4c24-8ec1-6d5a2d8b1843 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-4b40a169-8274-4c12-8c72-993665bfc18d req-f2d75ec9-0f07-4c24-8ec1-6d5a2d8b1843 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:27 user nova-compute[73029]: WARNING nova.compute.manager [req-4b40a169-8274-4c12-8c72-993665bfc18d req-f2d75ec9-0f07-4c24-8ec1-6d5a2d8b1843 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-8ac791ec-7eb0-4442-b465-48b912df2761 for instance with vm_state building and task_state spawning.
Aug 10 00:37:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-5f0ffbcd-1de4-4847-ad8b-0a9def7ba180 req-64370ba4-4761-470b-b1cc-f3624ce8d1a8 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5f0ffbcd-1de4-4847-ad8b-0a9def7ba180 req-64370ba4-4761-470b-b1cc-f3624ce8d1a8 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5f0ffbcd-1de4-4847-ad8b-0a9def7ba180 req-64370ba4-4761-470b-b1cc-f3624ce8d1a8 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5f0ffbcd-1de4-4847-ad8b-0a9def7ba180 req-64370ba4-4761-470b-b1cc-f3624ce8d1a8 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-5f0ffbcd-1de4-4847-ad8b-0a9def7ba180 req-64370ba4-4761-470b-b1cc-f3624ce8d1a8 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:28 user nova-compute[73029]: WARNING nova.compute.manager [req-5f0ffbcd-1de4-4847-ad8b-0a9def7ba180 req-64370ba4-4761-470b-b1cc-f3624ce8d1a8 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-4ee226a2-f9d2-4055-8745-13664dffb75b for instance with vm_state building and task_state spawning.
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:29 user nova-compute[73029]: WARNING nova.compute.manager [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-8ac791ec-7eb0-4442-b465-48b912df2761 for instance with vm_state building and task_state spawning.
Aug 10 00:37:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:29 user nova-compute[73029]: WARNING nova.compute.manager [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-13993caf-e057-46cb-b468-16a2ac962265 for instance with vm_state building and task_state spawning.
Aug 10 00:37:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:29 user nova-compute[73029]: WARNING nova.compute.manager [req-2cf7e22d-578a-454a-9ac3-9cbfa55f2b32 req-7d4c6508-6cb7-414d-8306-a6f065d516bc service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-13993caf-e057-46cb-b468-16a2ac962265 for instance with vm_state building and task_state spawning.
Aug 10 00:37:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpYvqkFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:30 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:30 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:30 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[423eccb6-62e3-4de4-941d-a5c0a184be6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:30 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e01f5ec-edde-421f-bf97-ddd060f48520]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83] added
Aug 10 00:37:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc93ab9-7e47-43ce-92da-bd2a2dc0ceb3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d41ae9-4884-40f7-a3ea-409c3f365630]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lpYvqkFr {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lpYvqkFr" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdbfa96-1bf8-4dce-8d55-2f094cdc185e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lpYvqkFr'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9abca1d-c001-4aac-b394-37399f94a796]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e7248e-c196-407a-9139-c82f9b895def]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:30 user nova-compute[73029]: WARNING nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-4ee226a2-f9d2-4055-8745-13664dffb75b for instance with vm_state building and task_state spawning.
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:30 user nova-compute[73029]: WARNING nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-cca97791-958d-430b-9b6e-6125b2d4d28e for instance with vm_state building and task_state spawning.
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:30 user nova-compute[73029]: WARNING nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-cca97791-958d-430b-9b6e-6125b2d4d28e for instance with vm_state building and task_state spawning.
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:30 user nova-compute[73029]: WARNING nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 for instance with vm_state building and task_state spawning.
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:30 user nova-compute[73029]: WARNING nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 for instance with vm_state building and task_state spawning.
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:30 user nova-compute[73029]: WARNING nova.compute.manager [req-c69d6587-2836-4791-bad2-8d21abb3b4c9 req-d65d7d16-b6bd-4352-9020-8a9ca50bfd78 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 for instance with vm_state building and task_state spawning.
Aug 10 00:37:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --login" returned: 0 in 0.125s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67838a2-0112-44e7-8ca9-42595e971851]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83, portal: 172.16.0.220,3260]
Aug 10 00:37:30 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[463be8d2-2d9f-471d-8336-2fea18449dfd]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0f098a-4f95-4eba-8a90-8ad664974dfc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:30 user nova-compute[73029]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 (non-flash)
Aug 10 00:37:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.047s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fed6873-b970-4a6d-8ee6-31930c7135a4]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpYvqkFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '26264663138616231', 'path': '/dev/sdh'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264663138616231', 'path': '/dev/sdh'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG nova.objects.instance [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lazy-loading 'flavor' on Instance uuid 0012ccc2-0fdf-4bdc-84c7-be4279032bdd {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:37:31 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:31 user nova-compute[73029]:   <source dev="/dev/sdh"/>
Aug 10 00:37:31 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:37:31 user nova-compute[73029]:   <serial>1960c40a-9aad-4c7a-97a3-112d4c36cd83</serial>
Aug 10 00:37:31 user nova-compute[73029]: </disk>
Aug 10 00:37:31 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-c6ec79d6-3dba-4246-85a8-58e019c9c618 req-98f980c9-6fc4-4867-89e8-eed0123f5920 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received event network-changed-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-c6ec79d6-3dba-4246-85a8-58e019c9c618 req-98f980c9-6fc4-4867-89e8-eed0123f5920 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Refreshing instance network info cache due to event network-changed-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c6ec79d6-3dba-4246-85a8-58e019c9c618 req-98f980c9-6fc4-4867-89e8-eed0123f5920 service nova] Acquiring lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c6ec79d6-3dba-4246-85a8-58e019c9c618 req-98f980c9-6fc4-4867-89e8-eed0123f5920 service nova] Acquired lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:31 user nova-compute[73029]: DEBUG nova.network.neutron [req-c6ec79d6-3dba-4246-85a8-58e019c9c618 req-98f980c9-6fc4-4867-89e8-eed0123f5920 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Refreshing network info cache for port 98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:32 user nova-compute[73029]: WARNING nova.compute.manager [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-ee0d0456-d275-4932-a6ff-3de6fb281337 for instance with vm_state building and task_state spawning.
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:32 user nova-compute[73029]: WARNING nova.compute.manager [req-a60aaed6-3dd4-4825-9242-04b15e6aa28b req-33a4df38-e83a-4c02-98c0-04a0020667ba service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-ee0d0456-d275-4932-a6ff-3de6fb281337 for instance with vm_state building and task_state spawning.
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] No VIF found with MAC fa:16:3e:40:66:5e, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627852.185515, cc846d6c-027a-4a9a-819f-27919f3d2b25 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:37:32 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] VM Resumed (Lifecycle Event)
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:37:32 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance spawned successfully.
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-d522b019-b074-4576-b04b-e2e7ffb78d06 req-49d12bcd-6bf5-42df-8206-b6944b34b96b service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d522b019-b074-4576-b04b-e2e7ffb78d06 req-49d12bcd-6bf5-42df-8206-b6944b34b96b service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d522b019-b074-4576-b04b-e2e7ffb78d06 req-49d12bcd-6bf5-42df-8206-b6944b34b96b service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d522b019-b074-4576-b04b-e2e7ffb78d06 req-49d12bcd-6bf5-42df-8206-b6944b34b96b service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-d522b019-b074-4576-b04b-e2e7ffb78d06 req-49d12bcd-6bf5-42df-8206-b6944b34b96b service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:32 user nova-compute[73029]: WARNING nova.compute.manager [req-d522b019-b074-4576-b04b-e2e7ffb78d06 req-49d12bcd-6bf5-42df-8206-b6944b34b96b service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 for instance with vm_state building and task_state spawning.
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-132cb3d7-46b7-4fc7-9673-cc6653a1e993 tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.943s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:37:32 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627852.1859376, cc846d6c-027a-4a9a-819f-27919f3d2b25 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:37:32 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] VM Started (Lifecycle Event)
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:37:32 user nova-compute[73029]: INFO nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Took 12.74 seconds to spawn the instance on the hypervisor.
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:32 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.network.neutron [req-c6ec79d6-3dba-4246-85a8-58e019c9c618 req-98f980c9-6fc4-4867-89e8-eed0123f5920 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updated VIF entry in instance network info cache for port 98438a2e-6f9b-4fe4-b0b8-216dc9a794bb. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG nova.network.neutron [req-c6ec79d6-3dba-4246-85a8-58e019c9c618 req-98f980c9-6fc4-4867-89e8-eed0123f5920 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updating instance_info_cache with network_info: [{"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c6ec79d6-3dba-4246-85a8-58e019c9c618 req-98f980c9-6fc4-4867-89e8-eed0123f5920 service nova] Releasing lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:32 user nova-compute[73029]: INFO nova.compute.manager [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Took 53.63 seconds to build instance.
Aug 10 00:37:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-86ce06d4-0685-4282-b433-337dec425fa0 tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.739s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:33 user nova-compute[73029]: INFO nova.compute.manager [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Terminating instance
Aug 10 00:37:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:33 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Instance destroyed successfully.
Aug 10 00:37:33 user nova-compute[73029]: DEBUG nova.objects.instance [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lazy-loading 'resources' on Instance uuid 0012ccc2-0fdf-4bdc-84c7-be4279032bdd {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1732138413',display_name='tempest-DeleteServersTestJSON-server-1732138413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1732138413',id=1,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c74ba6ca527d41eca4d817804f405d23',ramdisk_id='',reservation_id='r-hm3h0a4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-602116791',owner_user_name='tempest-DeleteServersTestJSON-602116791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:35:47Z,user_data=None,user_id='675a2c106bab4b4d844a1dc6695c6b7e',uuid=0012ccc2-0fdf-4bdc-84c7-be4279032bdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Converting VIF {"id": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "address": "fa:16:3e:40:66:5e", "network": {"id": "d6aa8cdd-983c-41e3-a946-69480ea2bd8c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106562851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c74ba6ca527d41eca4d817804f405d23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c23b28-3d", "ovs_interfaceid": "c1c23b28-3de6-48e2-b8ab-8ba102f025cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=c1c23b28-3de6-48e2-b8ab-8ba102f025cb,network=Network(d6aa8cdd-983c-41e3-a946-69480ea2bd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c23b28-3d') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG os_vif [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=c1c23b28-3de6-48e2-b8ab-8ba102f025cb,network=Network(d6aa8cdd-983c-41e3-a946-69480ea2bd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c23b28-3d') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1c23b28-3d, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:33 user nova-compute[73029]: INFO os_vif [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=c1c23b28-3de6-48e2-b8ab-8ba102f025cb,network=Network(d6aa8cdd-983c-41e3-a946-69480ea2bd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c23b28-3d')
Aug 10 00:37:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpYvqkFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:33 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[014ca482-0ce2-47ac-a753-e5ed1015621c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fa89d5-e164-4485-9267-1fe7ed825819]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 (non-flash)
Aug 10 00:37:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:34 user nova-compute[73029]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 (non-flash)
Aug 10 00:37:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7514511510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83'): ({'sdh'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Removing single pathed devices sdh {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[060073d6-3730-490d-88da-6546406745fc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-ec78ec44-6747-4c67-a6c6-1ee2c2418576 req-97def861-f682-4711-8bc0-b60f7345a8fa service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received event network-vif-unplugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ec78ec44-6747-4c67-a6c6-1ee2c2418576 req-97def861-f682-4711-8bc0-b60f7345a8fa service nova] Acquiring lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ec78ec44-6747-4c67-a6c6-1ee2c2418576 req-97def861-f682-4711-8bc0-b60f7345a8fa service nova] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ec78ec44-6747-4c67-a6c6-1ee2c2418576 req-97def861-f682-4711-8bc0-b60f7345a8fa service nova] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-ec78ec44-6747-4c67-a6c6-1ee2c2418576 req-97def861-f682-4711-8bc0-b60f7345a8fa service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] No waiting events found dispatching network-vif-unplugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-ec78ec44-6747-4c67-a6c6-1ee2c2418576 req-97def861-f682-4711-8bc0-b60f7345a8fa service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received event network-vif-unplugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b592a76-9c04-4735-a4f3-d2169bb9fcc9]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Flushing IO for device /dev/sdh {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e78c57f-7f85-4cce-a3ad-f894f4ceca6a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3794c6c5-0b2f-411c-9381-ccb4a5d9792e]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] SCSI volumes sdh have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f004f474-0b4f-406b-b84c-4776440157af]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.142s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54cb333-fba8-402b-a4dd-e8a19e907989]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83, portal: 172.16.0.220,3260]
Aug 10 00:37:34 user nova-compute[73029]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1960c40a-9aad-4c7a-97a3-112d4c36cd83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8fba21-b70b-4d46-b4df-d4b041ad8bc3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] <== disconnect_volume: return (427ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:37:34 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Deleting instance files /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd_del
Aug 10 00:37:34 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Deletion of /opt/stack/data/nova/instances/0012ccc2-0fdf-4bdc-84c7-be4279032bdd_del complete
Aug 10 00:37:34 user nova-compute[73029]: INFO nova.compute.manager [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lazy-loading 'flavor' on Instance uuid 77e0dc6b-541f-4032-9f93-f0cc395b0a22 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:35 user nova-compute[73029]: INFO nova.compute.manager [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Attaching volume b687544f-8bc6-485c-a50a-11b255f95766 to /dev/vdb
Aug 10 00:37:35 user nova-compute[73029]: DEBUG os_brick.utils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff0e68b-f37c-42ac-b506-9bbaacade6bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd94f821-3926-4234-a1df-3291e2fb988d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[139ec035-b120-4bf4-bcd2-e6148d895f0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e73a92a-428d-4812-9690-ae21720c866c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:35 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:37:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4320968b-d428-4b7b-abd8-dc4f3ab9db5f]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG os_brick.utils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Updating existing volume attachment record: 495c0cdf-c9a0-47d4-a6f7-30c11003cbc6 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:37:35 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:35 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Took 0.89 seconds to deallocate network for instance.
Aug 10 00:37:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received event network-vif-plugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] Acquiring lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] No waiting events found dispatching network-vif-plugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:36 user nova-compute[73029]: WARNING nova.compute.manager [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received unexpected event network-vif-plugged-c1c23b28-3de6-48e2-b8ab-8ba102f025cb for instance with vm_state active and task_state deleting.
Aug 10 00:37:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received event network-changed-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Refreshing instance network info cache due to event network-changed-fec11eed-17da-425c-89be-003dfd7f60c6. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] Acquiring lock "refresh_cache-77e0dc6b-541f-4032-9f93-f0cc395b0a22" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] Acquired lock "refresh_cache-77e0dc6b-541f-4032-9f93-f0cc395b0a22" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG nova.network.neutron [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Refreshing network info cache for port fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:36 user nova-compute[73029]: INFO nova.compute.manager [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Took 1.13 seconds to detach 1 volumes for instance.
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG nova.objects.instance [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lazy-loading 'flavor' on Instance uuid e7d1898b-0b2e-4feb-9d06-48e20eb9e409 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG nova.network.neutron [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Updated VIF entry in instance network info cache for port fec11eed-17da-425c-89be-003dfd7f60c6. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG nova.network.neutron [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Updating instance_info_cache with network_info: [{"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] Releasing lock "refresh_cache-77e0dc6b-541f-4032-9f93-f0cc395b0a22" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-4d6e804f-89ba-4112-a9af-7045f1dc68f2 req-f9c06f36-7e6c-4118-af46-c84802413237 service nova] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Received event network-vif-deleted-c1c23b28-3de6-48e2-b8ab-8ba102f025cb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.129s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:37 user nova-compute[73029]: INFO nova.compute.manager [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Attaching volume 41e8a234-58c9-42fc-bc21-4d0fec2346c8 to /dev/vdb
Aug 10 00:37:37 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG os_brick.utils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:37 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Deleted allocations for instance 0012ccc2-0fdf-4bdc-84c7-be4279032bdd
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f384c6-5f69-42c3-863a-6848204b82d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce5994-ea9c-4ab1-9635-427bcf8c508a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a5228e-f928-40cf-ab26-b2089de46670]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed0507e-18c4-4256-adc1-6ec5ee954b14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:37 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94a7acd-12fe-4d9f-b8e5-79ec72a596c4]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG os_brick.utils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updating existing volume attachment record: dc562314-1c4e-43bd-b766-6e083aa52224 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-41ae43f4-3f83-4705-a6bf-5bf001fc611c tempest-DeleteServersTestJSON-602116791 tempest-DeleteServersTestJSON-602116791-project-member] Lock "0012ccc2-0fdf-4bdc-84c7-be4279032bdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.311s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSKZmJde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:39 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:39 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:39 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b791529c-9fd8-43e6-ac2f-1636e650d3af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:39 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9232d74f-03e0-4817-8287-4dd3a146aef6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609] added
Aug 10 00:37:39 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9e1aa9-fdec-4a41-896e-85a8e3778bcb]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fe83d0-40dc-4feb-99e9-9ce60171a134]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSKZmJde {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSKZmJde" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aff864-8cd1-4f6d-a817-ad3c17626623]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSKZmJde'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e3fd7c-ed0e-4b5c-9bef-db47c0663627]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d6c71c-74fc-4d4e-a81a-b2752fbff1ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:39 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:39 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aef8a4-3abf-4baa-9cac-7c51ae33b8d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609, portal: 172.16.0.220,3260]
Aug 10 00:37:39 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:39 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c75c2f-1943-4cc6-953a-b5ae1efb59b5]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe3a53c-74d4-439a-891f-27938a780f3a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:39 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:39 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[892cec82-7999-4cc0-a135-2d53af3c77f1]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSKZmJde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23533326438666335', 'path': '/dev/sdh'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533326438666335', 'path': '/dev/sdh'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:40 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'flavor' on Instance uuid aa5be433-9c8a-4e52-b61d-15a84f188cc3 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:37:40 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:40 user nova-compute[73029]:   <source dev="/dev/sdh"/>
Aug 10 00:37:40 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:37:40 user nova-compute[73029]:   <serial>7d7b49d9-01cd-4e20-8ec5-05fafa9c0609</serial>
Aug 10 00:37:40 user nova-compute[73029]: </disk>
Aug 10 00:37:40 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:37:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No VIF found with MAC fa:16:3e:a1:9b:d7, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2add1ec2-4c6b-45c4-9f61-f7d7e9b3cf3a tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.545s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-13760f25-47da-4b4b-9a55-263ea7852ffd req-62273855-eb2c-4f16-a7c1-85c0357150bf service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-changed-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-13760f25-47da-4b4b-9a55-263ea7852ffd req-62273855-eb2c-4f16-a7c1-85c0357150bf service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Refreshing instance network info cache due to event network-changed-05000558-c8bc-4dfc-b4de-5debccaa24fe. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-13760f25-47da-4b4b-9a55-263ea7852ffd req-62273855-eb2c-4f16-a7c1-85c0357150bf service nova] Acquiring lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-13760f25-47da-4b4b-9a55-263ea7852ffd req-62273855-eb2c-4f16-a7c1-85c0357150bf service nova] Acquired lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG nova.network.neutron [req-13760f25-47da-4b4b-9a55-263ea7852ffd req-62273855-eb2c-4f16-a7c1-85c0357150bf service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Refreshing network info cache for port 05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "interface-118963ea-d3cf-4c10-945f-4718a02412c1-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "interface-118963ea-d3cf-4c10-945f-4718a02412c1-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lazy-loading 'flavor' on Instance uuid 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lazy-loading 'pci_requests' on Instance uuid 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG nova.network.neutron [req-13760f25-47da-4b4b-9a55-263ea7852ffd req-62273855-eb2c-4f16-a7c1-85c0357150bf service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updated VIF entry in instance network info cache for port 05000558-c8bc-4dfc-b4de-5debccaa24fe. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG nova.network.neutron [req-13760f25-47da-4b4b-9a55-263ea7852ffd req-62273855-eb2c-4f16-a7c1-85c0357150bf service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updating instance_info_cache with network_info: [{"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG nova.policy [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b480acf3baa421ba056043c717e942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8942a3a3544a2dac7a3a89a864dd0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-13760f25-47da-4b4b-9a55-263ea7852ffd req-62273855-eb2c-4f16-a7c1-85c0357150bf service nova] Releasing lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:37:45 user nova-compute[73029]: INFO nova.compute.claims [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Claim successful on node user
Aug 10 00:37:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "f1561416-585d-4d7d-a1d7-86a64cf00630" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Successfully created port: 8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:37:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.260s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:37:46 user nova-compute[73029]: INFO nova.compute.claims [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Claim successful on node user
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.network.neutron [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:37:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:37:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Creating image(s)
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "/opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "/opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.policy [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c16b4b3e2e34e5e9e53dcfaf4b948dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db8d6b005e844e3b1232942bf67fb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.158s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk 1073741824" returned: 0 in 0.093s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.174s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:37:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NEeSkcgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:47 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:47 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:47 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Cannot resize image /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.objects.instance [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lazy-loading 'migration_context' on Instance uuid dc191a1a-b684-4b2a-8cee-0572a6396b0d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Ensure instance console log exists: /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[289f3705-873e-4379-92d7-b3272eb45476]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:47 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedf5fbe-7f51-400a-b85b-27a6098a02e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766] added
Aug 10 00:37:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d31faa-84a0-4b03-9636-17dae73ee27a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:37:47 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Creating image(s)
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "/opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "/opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.policy [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad4b1f5525d54f399db688f2ff7f0752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ec174542da4ef6ac5751fb12c9f808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ef870-001a-47c3-85bc-3e936e25adee]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Successfully updated port: 8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NEeSkcgJ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NEeSkcgJ" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4859c1-85c0-4c5c-91c0-974ac202fb6b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NEeSkcgJ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquired lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a585cf-7098-4273-8b03-a54ebba03f50]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-554fcd5d-1dd7-4053-b043-4f4c54b34655 req-64bdd6de-93b8-432f-b8d4-1184702be536 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-changed-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-554fcd5d-1dd7-4053-b043-4f4c54b34655 req-64bdd6de-93b8-432f-b8d4-1184702be536 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Refreshing instance network info cache due to event network-changed-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-554fcd5d-1dd7-4053-b043-4f4c54b34655 req-64bdd6de-93b8-432f-b8d4-1184702be536 service nova] Acquiring lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41dbaf7-a652-4e9f-a7b2-32e26bc678d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa827c-f331-4aa8-ba90-88ecf4ff7ef5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766, portal: 172.16.0.220,3260]
Aug 10 00:37:47 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-6273de44-ab52-4ba1-99c7-d85c912188a0 req-42a69312-d8c5-44af-a6d7-5c9794bad682 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-changed-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-6273de44-ab52-4ba1-99c7-d85c912188a0 req-42a69312-d8c5-44af-a6d7-5c9794bad682 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Refreshing instance network info cache due to event network-changed-70ffb577-36a7-4e12-af57-d8d6afbbd5cd. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6273de44-ab52-4ba1-99c7-d85c912188a0 req-42a69312-d8c5-44af-a6d7-5c9794bad682 service nova] Acquiring lock "refresh_cache-68b798ae-944c-40f4-9747-79d60e9bf6ee" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6273de44-ab52-4ba1-99c7-d85c912188a0 req-42a69312-d8c5-44af-a6d7-5c9794bad682 service nova] Acquired lock "refresh_cache-68b798ae-944c-40f4-9747-79d60e9bf6ee" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.network.neutron [req-6273de44-ab52-4ba1-99c7-d85c912188a0 req-42a69312-d8c5-44af-a6d7-5c9794bad682 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Refreshing network info cache for port 70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d31b548-8112-4090-ab09-38eb5e8c9eab]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.168s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[15714c13-74b1-41b3-b315-3213f51b544e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:47 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.499s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk 1073741824" returned: 0 in 0.068s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c613d2f0-2e63-40ce-b812-e888f5f588af]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NEeSkcgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.181s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Cannot resize image /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:37:47 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'migration_context' on Instance uuid f1561416-585d-4d7d-a1d7-86a64cf00630 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Ensure instance console log exists: /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.network.neutron [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Successfully created port: a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.network.neutron [req-6273de44-ab52-4ba1-99c7-d85c912188a0 req-42a69312-d8c5-44af-a6d7-5c9794bad682 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Updated VIF entry in instance network info cache for port 70ffb577-36a7-4e12-af57-d8d6afbbd5cd. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.network.neutron [req-6273de44-ab52-4ba1-99c7-d85c912188a0 req-42a69312-d8c5-44af-a6d7-5c9794bad682 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Updating instance_info_cache with network_info: [{"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6273de44-ab52-4ba1-99c7-d85c912188a0 req-42a69312-d8c5-44af-a6d7-5c9794bad682 service nova] Releasing lock "refresh_cache-68b798ae-944c-40f4-9747-79d60e9bf6ee" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.601s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] <== connect_volume: return (1604ms) {'type': 'block', 'scsi_wwn': '23461393938643230', 'path': '/dev/sdi'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461393938643230', 'path': '/dev/sdi'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lazy-loading 'flavor' on Instance uuid 77e0dc6b-541f-4032-9f93-f0cc395b0a22 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] attach device xml: <disk type="block" device="disk">
Aug 10 00:37:48 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:48 user nova-compute[73029]:   <source dev="/dev/sdi"/>
Aug 10 00:37:48 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:37:48 user nova-compute[73029]:   <serial>b687544f-8bc6-485c-a50a-11b255f95766</serial>
Aug 10 00:37:48 user nova-compute[73029]: </disk>
Aug 10 00:37:48 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627853.906044, 0012ccc2-0fdf-4bdc-84c7-be4279032bdd => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:37:48 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] VM Stopped (Lifecycle Event)
Aug 10 00:37:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f5726687-0e31-4408-a6f4-8f898e215cec None None] [instance: 0012ccc2-0fdf-4bdc-84c7-be4279032bdd] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpnJczUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:49 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:49 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:49 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updating instance_info_cache with network_info: [{"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Successfully created port: 50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Releasing lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61c5edd-8f5d-41e4-8358-5f0fad970be9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-554fcd5d-1dd7-4053-b043-4f4c54b34655 req-64bdd6de-93b8-432f-b8d4-1184702be536 service nova] Acquired lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.network.neutron [req-554fcd5d-1dd7-4053-b043-4f4c54b34655 req-64bdd6de-93b8-432f-b8d4-1184702be536 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Refreshing network info cache for port 8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:37:49 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-352229283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-352229283',id=7,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSQZlX8tI3HUwW5UVA7H4kJ0KQcIp1DOQA6cc1Hg9qny8FShjYMyHMG2A1DuZmIP9gEfAxzEQzKQ18gbQeFKmztjw82TU4PUw9XXXpr4uKfgwEa89ahnNeAGiXSbMh7qA==',key_name='tempest-keypair-1362690543',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db8942a3a3544a2dac7a3a89a864dd0b',ramdisk_id='',reservation_id='r-yhqgxnwe',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1142167359',owner_user_name='tempest-TaggedAttachmentsTest-1142167359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b480acf3baa421ba056043c717e942f',uuid=118963ea-d3cf-4c10-945f-4718a02412c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converting VIF {"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:68,bridge_name='br-int',has_traffic_filtering=True,id=8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5,network=Network(3d377ef4-f77f-4e34-8344-582a4d219625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dcc9fd9-8b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_vif [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:68,bridge_name='br-int',has_traffic_filtering=True,id=8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5,network=Network(3d377ef4-f77f-4e34-8344-582a4d219625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dcc9fd9-8b') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8dcc9fd9-8b, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8dcc9fd9-8b, col_values=(('external_ids', {'iface-id': '8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:87:68', 'vm-uuid': '118963ea-d3cf-4c10-945f-4718a02412c1'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] No VIF found with MAC fa:16:3e:a9:15:c8, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[602b2859-fa99-42f4-a3ba-b3873e6a642d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: INFO os_vif [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:68,bridge_name='br-int',has_traffic_filtering=True,id=8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5,network=Network(3d377ef4-f77f-4e34-8344-582a4d219625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dcc9fd9-8b')
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-352229283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-352229283',id=7,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSQZlX8tI3HUwW5UVA7H4kJ0KQcIp1DOQA6cc1Hg9qny8FShjYMyHMG2A1DuZmIP9gEfAxzEQzKQ18gbQeFKmztjw82TU4PUw9XXXpr4uKfgwEa89ahnNeAGiXSbMh7qA==',key_name='tempest-keypair-1362690543',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db8942a3a3544a2dac7a3a89a864dd0b',ramdisk_id='',reservation_id='r-yhqgxnwe',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1142167359',owner_user_name='tempest-TaggedAttachmentsTest-1142167359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b480acf3baa421ba056043c717e942f',uuid=118963ea-d3cf-4c10-945f-4718a02412c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converting VIF {"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:68,bridge_name='br-int',has_traffic_filtering=True,id=8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5,network=Network(3d377ef4-f77f-4e34-8344-582a4d219625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dcc9fd9-8b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8] added
Aug 10 00:37:49 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] attach device xml: <interface type="ethernet">
Aug 10 00:37:49 user nova-compute[73029]:   <mac address="fa:16:3e:38:87:68"/>
Aug 10 00:37:49 user nova-compute[73029]:   <model type="virtio"/>
Aug 10 00:37:49 user nova-compute[73029]:   <mtu size="1442"/>
Aug 10 00:37:49 user nova-compute[73029]:   <target dev="tap8dcc9fd9-8b"/>
Aug 10 00:37:49 user nova-compute[73029]: </interface>
Aug 10 00:37:49 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3e1b65-8ff6-447d-ab65-b6d4c59d484d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b217ab-4045-4692-b092-5a3332725531]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lpnJczUA {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lpnJczUA" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e4b76f-f198-4591-b30c-87c1cc424662]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lpnJczUA'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b480d32-6a76-4b17-ba39-e30a031a6fc3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e5a04d-f14c-446d-9232-529581347fa8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d57b3727-68b4-44d6-832f-c910feea8aaa tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.276s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4f8f69-b3a1-4a48-88e9-9854f145842f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8, portal: 172.16.0.220,3260]
Aug 10 00:37:49 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:49 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fec1f39-839f-4c73-8c53-b669be08fb2e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4358dc-deb4-46c4-b6c0-a5b076a737d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:49 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:49 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.467s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f518b30-195f-4c0e-905e-e0ff08042fae]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpnJczUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] No BDM found with device name hda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] No VIF found with MAC fa:16:3e:d0:f6:08, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:37:49 user nova-compute[73029]:   <nova:package version="0.0.0"/>
Aug 10 00:37:49 user nova-compute[73029]:   <nova:name>tempest-device-tagging-server-352229283</nova:name>
Aug 10 00:37:49 user nova-compute[73029]:   <nova:creationTime>2023-08-10 00:37:49</nova:creationTime>
Aug 10 00:37:49 user nova-compute[73029]:   <nova:flavor name="m1.tiny">
Aug 10 00:37:49 user nova-compute[73029]:     <nova:memory>512</nova:memory>
Aug 10 00:37:49 user nova-compute[73029]:     <nova:disk>1</nova:disk>
Aug 10 00:37:49 user nova-compute[73029]:     <nova:swap>0</nova:swap>
Aug 10 00:37:49 user nova-compute[73029]:     <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:37:49 user nova-compute[73029]:     <nova:vcpus>1</nova:vcpus>
Aug 10 00:37:49 user nova-compute[73029]:   </nova:flavor>
Aug 10 00:37:49 user nova-compute[73029]:   <nova:owner>
Aug 10 00:37:49 user nova-compute[73029]:     <nova:user uuid="9b480acf3baa421ba056043c717e942f">tempest-TaggedAttachmentsTest-1142167359-project-member</nova:user>
Aug 10 00:37:49 user nova-compute[73029]:     <nova:project uuid="db8942a3a3544a2dac7a3a89a864dd0b">tempest-TaggedAttachmentsTest-1142167359</nova:project>
Aug 10 00:37:49 user nova-compute[73029]:   </nova:owner>
Aug 10 00:37:49 user nova-compute[73029]:   <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:37:49 user nova-compute[73029]:   <nova:ports>
Aug 10 00:37:49 user nova-compute[73029]:     <nova:port uuid="05000558-c8bc-4dfc-b4de-5debccaa24fe">
Aug 10 00:37:49 user nova-compute[73029]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 00:37:49 user nova-compute[73029]:     </nova:port>
Aug 10 00:37:49 user nova-compute[73029]:     <nova:port uuid="8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5">
Aug 10 00:37:49 user nova-compute[73029]:       <nova:ip type="fixed" address="10.10.10.78" ipVersion="4"/>
Aug 10 00:37:49 user nova-compute[73029]:     </nova:port>
Aug 10 00:37:49 user nova-compute[73029]:   </nova:ports>
Aug 10 00:37:49 user nova-compute[73029]: </nova:instance>
Aug 10 00:37:49 user nova-compute[73029]:  {{(pid=73029) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 10 00:37:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a06b9762-f611-4b07-a05c-e2da0236aa77 tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "interface-118963ea-d3cf-4c10-945f-4718a02412c1-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.437s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-32ede47e-b73c-41bc-9850-8d90fb0ed7dd req-73b8d16e-6894-400f-a070-25b27358b905 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-plugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32ede47e-b73c-41bc-9850-8d90fb0ed7dd req-73b8d16e-6894-400f-a070-25b27358b905 service nova] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32ede47e-b73c-41bc-9850-8d90fb0ed7dd req-73b8d16e-6894-400f-a070-25b27358b905 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32ede47e-b73c-41bc-9850-8d90fb0ed7dd req-73b8d16e-6894-400f-a070-25b27358b905 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-32ede47e-b73c-41bc-9850-8d90fb0ed7dd req-73b8d16e-6894-400f-a070-25b27358b905 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] No waiting events found dispatching network-vif-plugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:50 user nova-compute[73029]: WARNING nova.compute.manager [req-32ede47e-b73c-41bc-9850-8d90fb0ed7dd req-73b8d16e-6894-400f-a070-25b27358b905 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received unexpected event network-vif-plugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 for instance with vm_state active and task_state None.
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.objects.instance [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lazy-loading 'flavor' on Instance uuid 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Successfully updated port: a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b66a1e08-9922-4959-8f0f-f67d8a9acc3e tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] volume_snapshot_create: create_info: {'snapshot_id': '3cbee5bb-91a5-467a-953d-6d7c83ec2deb', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73029) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "refresh_cache-dc191a1a-b684-4b2a-8cee-0572a6396b0d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquired lock "refresh_cache-dc191a1a-b684-4b2a-8cee-0572a6396b0d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b66a1e08-9922-4959-8f0f-f67d8a9acc3e tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] snap xml: <domainsnapshot>
Aug 10 00:37:50 user nova-compute[73029]:   <disks>
Aug 10 00:37:50 user nova-compute[73029]:     <disk name="/dev/sdi" snapshot="external" type="file">
Aug 10 00:37:50 user nova-compute[73029]:       <source file="/dev/new_file"/>
Aug 10 00:37:50 user nova-compute[73029]:     </disk>
Aug 10 00:37:50 user nova-compute[73029]:     <disk name="vda" snapshot="no"/>
Aug 10 00:37:50 user nova-compute[73029]:   </disks>
Aug 10 00:37:50 user nova-compute[73029]: </domainsnapshot>
Aug 10 00:37:50 user nova-compute[73029]:  {{(pid=73029) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b66a1e08-9922-4959-8f0f-f67d8a9acc3e tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lazy-loading 'system_metadata' on Instance uuid 77e0dc6b-541f-4032-9f93-f0cc395b0a22 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b66a1e08-9922-4959-8f0f-f67d8a9acc3e tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [None req-b66a1e08-9922-4959-8f0f-f67d8a9acc3e tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     rv = execute(f, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     six.reraise(c, e, tb)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     raise value
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     rv = meth(*args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [None req-b66a1e08-9922-4959-8f0f-f67d8a9acc3e tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     self._volume_snapshot_create(context, instance, guest,
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     rv = execute(f, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     six.reraise(c, e, tb)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     raise value
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     rv = meth(*args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] 
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dda1d095-f243-4810-9895-de234d0ef02f tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] volume_snapshot_delete: delete_info: {'volume_id': 'b687544f-8bc6-485c-a50a-11b255f95766'} {{(pid=73029) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [None req-dda1d095-f243-4810-9895-de234d0ef02f tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22]     if delete_info['type'] != 'qcow2':
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] KeyError: 'type'
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [None req-dda1d095-f243-4810-9895-de234d0ef02f tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f5862c78-49ca-4408-b705-f1549ec2fcf4)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver [None req-b66a1e08-9922-4959-8f0f-f67d8a9acc3e tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 3cbee5bb-91a5-467a-953d-6d7c83ec2deb could not be found.
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     raise value
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 3cbee5bb-91a5-467a-953d-6d7c83ec2deb could not be found. (HTTP 404) (Request-ID: req-705fef27-7551-41c1-b696-3095b41e38ef)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 3cbee5bb-91a5-467a-953d-6d7c83ec2deb could not be found.
Aug 10 00:37:50 user nova-compute[73029]: ERROR nova.virt.libvirt.driver 
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:50 user nova-compute[73029]: INFO nova.compute.manager [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Attaching volume a610dbda-d973-468c-b19b-c4ac7542765f to /dev/vdb
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server [None req-dda1d095-f243-4810-9895-de234d0ef02f tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Exception during message handling: KeyError: 'type'
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server 
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server [None req-b66a1e08-9922-4959-8f0f-f67d8a9acc3e tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     raise value
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 10 00:37:50 user nova-compute[73029]: ERROR oslo_messaging.rpc.server 
Aug 10 00:37:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.522s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] <== connect_volume: return (1522ms) {'type': 'block', 'scsi_wwn': '23937356437313561', 'path': '/dev/sdj'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937356437313561', 'path': '/dev/sdj'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.objects.instance [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lazy-loading 'flavor' on Instance uuid e7d1898b-0b2e-4feb-9d06-48e20eb9e409 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG os_brick.utils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:37:50 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:50 user nova-compute[73029]:   <source dev="/dev/sdj"/>
Aug 10 00:37:50 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:37:50 user nova-compute[73029]:   <serial>41e8a234-58c9-42fc-bc21-4d0fec2346c8</serial>
Aug 10 00:37:50 user nova-compute[73029]: </disk>
Aug 10 00:37:50 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[90105989-140b-4e19-8755-cc9718181030]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7e4f2e-4455-435f-9bf3-b4440af29342]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[967eb8ba-09ed-4c0d-9ea6-92b6fb7f3261]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[af103d42-9f35-499d-a777-2a6dd1a8a1d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:50 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc7395-b40f-4cea-b884-debbb61b230a]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG os_brick.utils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updating existing volume attachment record: 071d7311-b378-4999-9ff4-3fae03f51d70 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:51 user nova-compute[73029]: INFO nova.compute.manager [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Detaching volume b687544f-8bc6-485c-a50a-11b255f95766
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.network.neutron [req-554fcd5d-1dd7-4053-b043-4f4c54b34655 req-64bdd6de-93b8-432f-b8d4-1184702be536 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updated VIF entry in instance network info cache for port 8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.network.neutron [req-554fcd5d-1dd7-4053-b043-4f4c54b34655 req-64bdd6de-93b8-432f-b8d4-1184702be536 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updating instance_info_cache with network_info: [{"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:51 user nova-compute[73029]: INFO nova.virt.block_device [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Attempting to driver detach volume b687544f-8bc6-485c-a50a-11b255f95766 from mountpoint /dev/vdb
Aug 10 00:37:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-554fcd5d-1dd7-4053-b043-4f4c54b34655 req-64bdd6de-93b8-432f-b8d4-1184702be536 service nova] Releasing lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Attempting to detach device vdb from instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] detach device xml: <disk type="block" device="disk">
Aug 10 00:37:51 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:51 user nova-compute[73029]:   <source dev="/dev/sdi"/>
Aug 10 00:37:51 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:37:51 user nova-compute[73029]:   <serial>b687544f-8bc6-485c-a50a-11b255f95766</serial>
Aug 10 00:37:51 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:37:51 user nova-compute[73029]: </disk>
Aug 10 00:37:51 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:37:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Successfully detached device vdb from instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22 from the persistent domain config.
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] detach device xml: <disk type="block" device="disk">
Aug 10 00:37:51 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:51 user nova-compute[73029]:   <source dev="/dev/sdi"/>
Aug 10 00:37:51 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:37:51 user nova-compute[73029]:   <serial>b687544f-8bc6-485c-a50a-11b255f95766</serial>
Aug 10 00:37:51 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:37:51 user nova-compute[73029]: </disk>
Aug 10 00:37:51 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] No VIF found with MAC fa:16:3e:8c:90:57, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-22cd1296-0030-47ab-965f-04d61763037a tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.322s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.network.neutron [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Updating instance_info_cache with network_info: [{"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691627871.7362175, 77e0dc6b-541f-4032-9f93-f0cc395b0a22 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:37:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Successfully detached device vdb from instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22 from the live domain config.
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NEeSkcgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:51 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Releasing lock "refresh_cache-dc191a1a-b684-4b2a-8cee-0572a6396b0d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Instance network_info: |[{"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Start _get_guest_xml network_info=[{"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:37:51 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:51 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2063515216',display_name='tempest-VolumesActionsTest-instance-2063515216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2063515216',id=12,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8d6b005e844e3b1232942bf67fb9a',ramdisk_id='',reservation_id='r-33iepqwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-261338927',owner_user_name='tempest-VolumesActionsTest-261338927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:37:46Z,user_data=None,user_id='9c16b4b3e2e34e5e9e53dcfaf4b948dd',uuid=dc191a1a-b684-4b2a-8cee-0572a6396b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converting VIF {"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:f3:22,bridge_name='br-int',has_traffic_filtering=True,id=a7bb0ebb-56fd-40db-becc-bcf28fc8749b,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bb0ebb-56') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.objects.instance [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lazy-loading 'pci_devices' on Instance uuid dc191a1a-b684-4b2a-8cee-0572a6396b0d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf2c25c-6992-42d8-9044-ec54eafa94c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Successfully updated port: 50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:37:51 user nova-compute[73029]:   <uuid>dc191a1a-b684-4b2a-8cee-0572a6396b0d</uuid>
Aug 10 00:37:51 user nova-compute[73029]:   <name>instance-0000000c</name>
Aug 10 00:37:51 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:37:51 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:37:51 user nova-compute[73029]:   <metadata>
Aug 10 00:37:51 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:37:51 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:37:51 user nova-compute[73029]:       <nova:name>tempest-VolumesActionsTest-instance-2063515216</nova:name>
Aug 10 00:37:51 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:37:51</nova:creationTime>
Aug 10 00:37:51 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:37:51 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:37:51 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:37:51 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:37:51 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:37:51 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:37:51 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:37:51 user nova-compute[73029]:       <nova:owner>
Aug 10 00:37:51 user nova-compute[73029]:         <nova:user uuid="9c16b4b3e2e34e5e9e53dcfaf4b948dd">tempest-VolumesActionsTest-261338927-project-member</nova:user>
Aug 10 00:37:51 user nova-compute[73029]:         <nova:project uuid="4db8d6b005e844e3b1232942bf67fb9a">tempest-VolumesActionsTest-261338927</nova:project>
Aug 10 00:37:51 user nova-compute[73029]:       </nova:owner>
Aug 10 00:37:51 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:37:51 user nova-compute[73029]:       <nova:ports>
Aug 10 00:37:51 user nova-compute[73029]:         <nova:port uuid="a7bb0ebb-56fd-40db-becc-bcf28fc8749b">
Aug 10 00:37:51 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 10 00:37:51 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:51 user nova-compute[73029]:       </nova:ports>
Aug 10 00:37:51 user nova-compute[73029]:     </nova:instance>
Aug 10 00:37:51 user nova-compute[73029]:   </metadata>
Aug 10 00:37:51 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:37:51 user nova-compute[73029]:     <system>
Aug 10 00:37:51 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:37:51 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:37:51 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:37:51 user nova-compute[73029]:       <entry name="serial">dc191a1a-b684-4b2a-8cee-0572a6396b0d</entry>
Aug 10 00:37:51 user nova-compute[73029]:       <entry name="uuid">dc191a1a-b684-4b2a-8cee-0572a6396b0d</entry>
Aug 10 00:37:51 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:37:51 user nova-compute[73029]:     </system>
Aug 10 00:37:51 user nova-compute[73029]:   </sysinfo>
Aug 10 00:37:51 user nova-compute[73029]:   <os>
Aug 10 00:37:51 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:37:51 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:37:51 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:37:51 user nova-compute[73029]:   </os>
Aug 10 00:37:51 user nova-compute[73029]:   <features>
Aug 10 00:37:51 user nova-compute[73029]:     <acpi/>
Aug 10 00:37:51 user nova-compute[73029]:     <apic/>
Aug 10 00:37:51 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:37:51 user nova-compute[73029]:   </features>
Aug 10 00:37:51 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:37:51 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:37:51 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:37:51 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:37:51 user nova-compute[73029]:   </clock>
Aug 10 00:37:51 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:37:51 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:37:51 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:37:51 user nova-compute[73029]:   </cpu>
Aug 10 00:37:51 user nova-compute[73029]:   <devices>
Aug 10 00:37:51 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:37:51 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:37:51 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk"/>
Aug 10 00:37:51 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:37:51 user nova-compute[73029]:     </disk>
Aug 10 00:37:51 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:51 user nova-compute[73029]:       <mac address="fa:16:3e:43:f3:22"/>
Aug 10 00:37:51 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:51 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:51 user nova-compute[73029]:       <target dev="tapa7bb0ebb-56"/>
Aug 10 00:37:51 user nova-compute[73029]:     </interface>
Aug 10 00:37:51 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:37:51 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/console.log" append="off"/>
Aug 10 00:37:51 user nova-compute[73029]:     </serial>
Aug 10 00:37:51 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:37:51 user nova-compute[73029]:     <video>
Aug 10 00:37:51 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:51 user nova-compute[73029]:     </video>
Aug 10 00:37:51 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:37:51 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:37:51 user nova-compute[73029]:     </rng>
Aug 10 00:37:51 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:37:51 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:37:51 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:37:51 user nova-compute[73029]:     </memballoon>
Aug 10 00:37:51 user nova-compute[73029]:   </devices>
Aug 10 00:37:51 user nova-compute[73029]: </domain>
Aug 10 00:37:51 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2063515216',display_name='tempest-VolumesActionsTest-instance-2063515216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2063515216',id=12,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8d6b005e844e3b1232942bf67fb9a',ramdisk_id='',reservation_id='r-33iepqwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-261338927',owner_user_name='tempest-VolumesActionsTest-261338927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:37:46Z,user_data=None,user_id='9c16b4b3e2e34e5e9e53dcfaf4b948dd',uuid=dc191a1a-b684-4b2a-8cee-0572a6396b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converting VIF {"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:f3:22,bridge_name='br-int',has_traffic_filtering=True,id=a7bb0ebb-56fd-40db-becc-bcf28fc8749b,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bb0ebb-56') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG os_vif [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:f3:22,bridge_name='br-int',has_traffic_filtering=True,id=a7bb0ebb-56fd-40db-becc-bcf28fc8749b,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bb0ebb-56') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7bb0ebb-56, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7bb0ebb-56, col_values=(('external_ids', {'iface-id': 'a7bb0ebb-56fd-40db-becc-bcf28fc8749b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:f3:22', 'vm-uuid': 'dc191a1a-b684-4b2a-8cee-0572a6396b0d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "refresh_cache-f1561416-585d-4d7d-a1d7-86a64cf00630" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquired lock "refresh_cache-f1561416-585d-4d7d-a1d7-86a64cf00630" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:37:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4280d13f-1670-430e-a808-326f7b2886cf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:52 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:52 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7514190820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766'): ({'sdi'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Removing single pathed devices sdi {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c126fa4c-8fc3-403f-b3dd-46f9f74a51fc]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[086a9c58-4b5a-4757-96bd-4943bf3485c5]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Flushing IO for device /dev/sdi {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6bafe6-046b-47d2-b72a-9d55038aed27]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.038s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6a5032-795c-48f1-ab88-db0df29cf5da]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] SCSI volumes sdi have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:52 user nova-compute[73029]: INFO os_vif [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:f3:22,bridge_name='br-int',has_traffic_filtering=True,id=a7bb0ebb-56fd-40db-becc-bcf28fc8749b,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bb0ebb-56')
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[79628e73-262d-4b1f-bc53-97cd8dc66137]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] No VIF found with MAC fa:16:3e:43:f3:22, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c003888-c39c-4a8f-a3e0-b6806266ab84]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766, portal: 172.16.0.220,3260]
Aug 10 00:37:52 user nova-compute[73029]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:52 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b687544f-8bc6-485c-a50a-11b255f95766 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baaa437-9799-4f23-a624-81abb4625554]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] <== disconnect_volume: return (427ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Updating instance_info_cache with network_info: [{"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received event network-changed-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Refreshing instance network info cache due to event network-changed-a7bb0ebb-56fd-40db-becc-bcf28fc8749b. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] Acquiring lock "refresh_cache-dc191a1a-b684-4b2a-8cee-0572a6396b0d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] Acquired lock "refresh_cache-dc191a1a-b684-4b2a-8cee-0572a6396b0d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Refreshing network info cache for port a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Releasing lock "refresh_cache-f1561416-585d-4d7d-a1d7-86a64cf00630" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Instance network_info: |[{"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Start _get_guest_xml network_info=[{"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:37:52 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:52 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-797632932',display_name='tempest-AttachVolumeNegativeTest-server-797632932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-797632932',id=13,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJqlT/TO2f5THRie2gUu0eZRSTF/ZSx3kThepwp7LKb13Uqrk1O0pB4ZAOCWWKQ5BXT647rl+w8+EeHkOV5gMklo2G/y3Vp5XUTDeY45eL7EGuj+7Z6Sd5LJJMFk17Yig==',key_name='tempest-keypair-1660648565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-zzgik21r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=f1561416-585d-4d7d-a1d7-86a64cf00630,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:06,bridge_name='br-int',has_traffic_filtering=True,id=50401080-b849-490d-a207-e48fa5eaf26d,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50401080-b8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'pci_devices' on Instance uuid f1561416-585d-4d7d-a1d7-86a64cf00630 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lazy-loading 'flavor' on Instance uuid 68b798ae-944c-40f4-9747-79d60e9bf6ee {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:37:52 user nova-compute[73029]:   <uuid>f1561416-585d-4d7d-a1d7-86a64cf00630</uuid>
Aug 10 00:37:52 user nova-compute[73029]:   <name>instance-0000000d</name>
Aug 10 00:37:52 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:37:52 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:37:52 user nova-compute[73029]:   <metadata>
Aug 10 00:37:52 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:37:52 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:37:52 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeNegativeTest-server-797632932</nova:name>
Aug 10 00:37:52 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:37:52</nova:creationTime>
Aug 10 00:37:52 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:37:52 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:37:52 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:37:52 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:37:52 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:37:52 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:37:52 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:37:52 user nova-compute[73029]:       <nova:owner>
Aug 10 00:37:52 user nova-compute[73029]:         <nova:user uuid="ad4b1f5525d54f399db688f2ff7f0752">tempest-AttachVolumeNegativeTest-685145765-project-member</nova:user>
Aug 10 00:37:52 user nova-compute[73029]:         <nova:project uuid="22ec174542da4ef6ac5751fb12c9f808">tempest-AttachVolumeNegativeTest-685145765</nova:project>
Aug 10 00:37:52 user nova-compute[73029]:       </nova:owner>
Aug 10 00:37:52 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:37:52 user nova-compute[73029]:       <nova:ports>
Aug 10 00:37:52 user nova-compute[73029]:         <nova:port uuid="50401080-b849-490d-a207-e48fa5eaf26d">
Aug 10 00:37:52 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 00:37:52 user nova-compute[73029]:         </nova:port>
Aug 10 00:37:52 user nova-compute[73029]:       </nova:ports>
Aug 10 00:37:52 user nova-compute[73029]:     </nova:instance>
Aug 10 00:37:52 user nova-compute[73029]:   </metadata>
Aug 10 00:37:52 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:37:52 user nova-compute[73029]:     <system>
Aug 10 00:37:52 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:37:52 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:37:52 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:37:52 user nova-compute[73029]:       <entry name="serial">f1561416-585d-4d7d-a1d7-86a64cf00630</entry>
Aug 10 00:37:52 user nova-compute[73029]:       <entry name="uuid">f1561416-585d-4d7d-a1d7-86a64cf00630</entry>
Aug 10 00:37:52 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:37:52 user nova-compute[73029]:     </system>
Aug 10 00:37:52 user nova-compute[73029]:   </sysinfo>
Aug 10 00:37:52 user nova-compute[73029]:   <os>
Aug 10 00:37:52 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:37:52 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:37:52 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:37:52 user nova-compute[73029]:   </os>
Aug 10 00:37:52 user nova-compute[73029]:   <features>
Aug 10 00:37:52 user nova-compute[73029]:     <acpi/>
Aug 10 00:37:52 user nova-compute[73029]:     <apic/>
Aug 10 00:37:52 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:37:52 user nova-compute[73029]:   </features>
Aug 10 00:37:52 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:37:52 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:37:52 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:37:52 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:37:52 user nova-compute[73029]:   </clock>
Aug 10 00:37:52 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:37:52 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:37:52 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:37:52 user nova-compute[73029]:   </cpu>
Aug 10 00:37:52 user nova-compute[73029]:   <devices>
Aug 10 00:37:52 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:37:52 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:37:52 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk"/>
Aug 10 00:37:52 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:37:52 user nova-compute[73029]:     </disk>
Aug 10 00:37:52 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:37:52 user nova-compute[73029]:       <mac address="fa:16:3e:9e:6b:06"/>
Aug 10 00:37:52 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:52 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:37:52 user nova-compute[73029]:       <target dev="tap50401080-b8"/>
Aug 10 00:37:52 user nova-compute[73029]:     </interface>
Aug 10 00:37:52 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:37:52 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/console.log" append="off"/>
Aug 10 00:37:52 user nova-compute[73029]:     </serial>
Aug 10 00:37:52 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:37:52 user nova-compute[73029]:     <video>
Aug 10 00:37:52 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:37:52 user nova-compute[73029]:     </video>
Aug 10 00:37:52 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:37:52 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:37:52 user nova-compute[73029]:     </rng>
Aug 10 00:37:52 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:37:52 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:37:52 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:37:52 user nova-compute[73029]:     </memballoon>
Aug 10 00:37:52 user nova-compute[73029]:   </devices>
Aug 10 00:37:52 user nova-compute[73029]: </domain>
Aug 10 00:37:52 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-797632932',display_name='tempest-AttachVolumeNegativeTest-server-797632932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-797632932',id=13,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJqlT/TO2f5THRie2gUu0eZRSTF/ZSx3kThepwp7LKb13Uqrk1O0pB4ZAOCWWKQ5BXT647rl+w8+EeHkOV5gMklo2G/y3Vp5XUTDeY45eL7EGuj+7Z6Sd5LJJMFk17Yig==',key_name='tempest-keypair-1660648565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-zzgik21r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=f1561416-585d-4d7d-a1d7-86a64cf00630,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:06,bridge_name='br-int',has_traffic_filtering=True,id=50401080-b849-490d-a207-e48fa5eaf26d,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50401080-b8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_vif [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:06,bridge_name='br-int',has_traffic_filtering=True,id=50401080-b849-490d-a207-e48fa5eaf26d,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50401080-b8') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50401080-b8, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50401080-b8, col_values=(('external_ids', {'iface-id': '50401080-b849-490d-a207-e48fa5eaf26d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:6b:06', 'vm-uuid': 'f1561416-585d-4d7d-a1d7-86a64cf00630'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:52 user nova-compute[73029]: INFO os_vif [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:06,bridge_name='br-int',has_traffic_filtering=True,id=50401080-b849-490d-a207-e48fa5eaf26d,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50401080-b8')
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No VIF found with MAC fa:16:3e:9e:6b:06, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:52 user nova-compute[73029]: INFO nova.compute.manager [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Attaching volume f6a4cb74-3db5-4902-a25a-49b819c3a354 to /dev/sdc
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:52 user nova-compute[73029]: INFO nova.compute.manager [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Detaching volume 41e8a234-58c9-42fc-bc21-4d0fec2346c8
Aug 10 00:37:52 user nova-compute[73029]: DEBUG os_brick.utils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f42e7bd-2377-4c90-82ee-50667759b2ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Updated VIF entry in instance network info cache for port a7bb0ebb-56fd-40db-becc-bcf28fc8749b. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Updating instance_info_cache with network_info: [{"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ecabf1-f684-4244-b25f-f0a3ef581056]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:52 user nova-compute[73029]: INFO nova.virt.block_device [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Attempting to driver detach volume 41e8a234-58c9-42fc-bc21-4d0fec2346c8 from mountpoint /dev/vdb
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] Releasing lock "refresh_cache-dc191a1a-b684-4b2a-8cee-0572a6396b0d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-plugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] No waiting events found dispatching network-vif-plugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:52 user nova-compute[73029]: WARNING nova.compute.manager [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received unexpected event network-vif-plugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 for instance with vm_state active and task_state None.
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received event network-changed-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Refreshing instance network info cache due to event network-changed-50401080-b849-490d-a207-e48fa5eaf26d. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:37:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] Acquiring lock "refresh_cache-f1561416-585d-4d7d-a1d7-86a64cf00630" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] Acquired lock "refresh_cache-f1561416-585d-4d7d-a1d7-86a64cf00630" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.network.neutron [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Refreshing network info cache for port 50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e10f2a-57be-4700-99d3-d8326b71f5c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a80dcf2-aa3b-4e77-bb8b-e14b218fb9e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:37:53 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4984a5-8191-4de5-9ff9-8d6401fb7a76]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.utils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Updating existing volume attachment record: 653585c4-3a23-411c-b928-96bb5bfe8715 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Attempting to detach device vdb from instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:37:53 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:53 user nova-compute[73029]:   <source dev="/dev/sdj"/>
Aug 10 00:37:53 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:37:53 user nova-compute[73029]:   <serial>41e8a234-58c9-42fc-bc21-4d0fec2346c8</serial>
Aug 10 00:37:53 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:37:53 user nova-compute[73029]: </disk>
Aug 10 00:37:53 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:37:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Successfully detached device vdb from instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 from the persistent domain config.
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:37:53 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:37:53 user nova-compute[73029]:   <source dev="/dev/sdj"/>
Aug 10 00:37:53 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:37:53 user nova-compute[73029]:   <serial>41e8a234-58c9-42fc-bc21-4d0fec2346c8</serial>
Aug 10 00:37:53 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:37:53 user nova-compute[73029]: </disk>
Aug 10 00:37:53 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.objects.instance [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lazy-loading 'flavor' on Instance uuid 77e0dc6b-541f-4032-9f93-f0cc395b0a22 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fdbaf183-5816-4d47-a51a-0a77c6846256 tempest-VolumesAssistedSnapshotsTest-1720783346 tempest-VolumesAssistedSnapshotsTest-1720783346-project-admin] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.220s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.network.neutron [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Updated VIF entry in instance network info cache for port 50401080-b849-490d-a207-e48fa5eaf26d. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.network.neutron [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Updating instance_info_cache with network_info: [{"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c651846-53f3-4832-867c-8bfd7578bc05 req-64b22a01-115e-41c5-b755-3b948c990e3f service nova] Releasing lock "refresh_cache-f1561416-585d-4d7d-a1d7-86a64cf00630" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-2609a6c5-1f73-4c8d-ac0c-836f1758b334 req-a633b9bf-15b3-4f54-8bcf-1ed8b7d6b533 service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received event network-vif-plugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2609a6c5-1f73-4c8d-ac0c-836f1758b334 req-a633b9bf-15b3-4f54-8bcf-1ed8b7d6b533 service nova] Acquiring lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2609a6c5-1f73-4c8d-ac0c-836f1758b334 req-a633b9bf-15b3-4f54-8bcf-1ed8b7d6b533 service nova] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2609a6c5-1f73-4c8d-ac0c-836f1758b334 req-a633b9bf-15b3-4f54-8bcf-1ed8b7d6b533 service nova] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-2609a6c5-1f73-4c8d-ac0c-836f1758b334 req-a633b9bf-15b3-4f54-8bcf-1ed8b7d6b533 service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] No waiting events found dispatching network-vif-plugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:53 user nova-compute[73029]: WARNING nova.compute.manager [req-2609a6c5-1f73-4c8d-ac0c-836f1758b334 req-a633b9bf-15b3-4f54-8bcf-1ed8b7d6b533 service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received unexpected event network-vif-plugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b for instance with vm_state building and task_state spawning.
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691627873.7324378, e7d1898b-0b2e-4feb-9d06-48e20eb9e409 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:37:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Successfully detached device vdb from instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 from the live domain config.
Aug 10 00:37:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpnJczUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:37:53 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00f5ce4-f9eb-41ed-ab72-05e9351f113c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81eed61-8e75-44e4-8a43-9be215c2196c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:37:53 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:37:53 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751c1931c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8'): ({'sdj'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Removing single pathed devices sdj {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[09968399-f508-49d8-a52c-2ee826ccfeb3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ddb748-a7a1-4948-bc04-0a807829b3c2]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Flushing IO for device /dev/sdj {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3428718-4e60-465f-aa51-3b92acd8d14b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a20c17-73df-4db4-98bc-13991f76b3a9]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] SCSI volumes sdj have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d345d4a-95c5-425d-963a-e7cf97d7bfe7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee85a12-fc8e-46a0-9cc7-609d73410a2c]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8, portal: 172.16.0.220,3260]
Aug 10 00:37:54 user nova-compute[73029]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8, portal: 172.16.0.220,3260] successful.
Aug 10 00:37:54 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e8a234-58c9-42fc-bc21-4d0fec2346c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0f901d-926a-44ac-9b0b-5341681031ae]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] <== disconnect_volume: return (380ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:37:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG nova.objects.instance [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lazy-loading 'flavor' on Instance uuid e7d1898b-0b2e-4feb-9d06-48e20eb9e409 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-23d4b811-b6da-4bb9-bf9b-f706294e51db tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.296s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-e4af0c5e-3c75-4d97-91ab-c026d0382f48 req-4c9e0074-fdea-4bca-ae46-e38214d344fe service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received event network-vif-plugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e4af0c5e-3c75-4d97-91ab-c026d0382f48 req-4c9e0074-fdea-4bca-ae46-e38214d344fe service nova] Acquiring lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e4af0c5e-3c75-4d97-91ab-c026d0382f48 req-4c9e0074-fdea-4bca-ae46-e38214d344fe service nova] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e4af0c5e-3c75-4d97-91ab-c026d0382f48 req-4c9e0074-fdea-4bca-ae46-e38214d344fe service nova] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-e4af0c5e-3c75-4d97-91ab-c026d0382f48 req-4c9e0074-fdea-4bca-ae46-e38214d344fe service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] No waiting events found dispatching network-vif-plugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:55 user nova-compute[73029]: WARNING nova.compute.manager [req-e4af0c5e-3c75-4d97-91ab-c026d0382f48 req-4c9e0074-fdea-4bca-ae46-e38214d344fe service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received unexpected event network-vif-plugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b for instance with vm_state building and task_state spawning.
Aug 10 00:37:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-300b5c0d-fe23-4fd4-aa2d-f3b056544ab3 req-afb3e563-f31d-4ed3-a2cd-c59623f37e7d service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received event network-vif-plugged-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-300b5c0d-fe23-4fd4-aa2d-f3b056544ab3 req-afb3e563-f31d-4ed3-a2cd-c59623f37e7d service nova] Acquiring lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-300b5c0d-fe23-4fd4-aa2d-f3b056544ab3 req-afb3e563-f31d-4ed3-a2cd-c59623f37e7d service nova] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-300b5c0d-fe23-4fd4-aa2d-f3b056544ab3 req-afb3e563-f31d-4ed3-a2cd-c59623f37e7d service nova] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-300b5c0d-fe23-4fd4-aa2d-f3b056544ab3 req-afb3e563-f31d-4ed3-a2cd-c59623f37e7d service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] No waiting events found dispatching network-vif-plugged-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:55 user nova-compute[73029]: WARNING nova.compute.manager [req-300b5c0d-fe23-4fd4-aa2d-f3b056544ab3 req-afb3e563-f31d-4ed3-a2cd-c59623f37e7d service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received unexpected event network-vif-plugged-50401080-b849-490d-a207-e48fa5eaf26d for instance with vm_state building and task_state spawning.
Aug 10 00:37:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627877.1317742, dc191a1a-b684-4b2a-8cee-0572a6396b0d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] VM Resumed (Lifecycle Event)
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Instance spawned successfully.
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627877.137918, dc191a1a-b684-4b2a-8cee-0572a6396b0d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] VM Started (Lifecycle Event)
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Took 10.90 seconds to spawn the instance on the hypervisor.
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Took 11.77 seconds to build instance.
Aug 10 00:37:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eaf84b73-3b98-4c7b-bafe-4fb684859ef5 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.906s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627877.74205, f1561416-585d-4d7d-a1d7-86a64cf00630 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] VM Resumed (Lifecycle Event)
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Instance spawned successfully.
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627877.7452986, f1561416-585d-4d7d-a1d7-86a64cf00630 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] VM Started (Lifecycle Event)
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-f9437e72-13c3-4612-a98c-3d7121234c45 req-90670ca3-8594-4f3d-9932-7cd7176c9295 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received event network-vif-plugged-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f9437e72-13c3-4612-a98c-3d7121234c45 req-90670ca3-8594-4f3d-9932-7cd7176c9295 service nova] Acquiring lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f9437e72-13c3-4612-a98c-3d7121234c45 req-90670ca3-8594-4f3d-9932-7cd7176c9295 service nova] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f9437e72-13c3-4612-a98c-3d7121234c45 req-90670ca3-8594-4f3d-9932-7cd7176c9295 service nova] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-f9437e72-13c3-4612-a98c-3d7121234c45 req-90670ca3-8594-4f3d-9932-7cd7176c9295 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] No waiting events found dispatching network-vif-plugged-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:37:57 user nova-compute[73029]: WARNING nova.compute.manager [req-f9437e72-13c3-4612-a98c-3d7121234c45 req-90670ca3-8594-4f3d-9932-7cd7176c9295 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received unexpected event network-vif-plugged-50401080-b849-490d-a207-e48fa5eaf26d for instance with vm_state building and task_state spawning.
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Took 10.66 seconds to spawn the instance on the hypervisor.
Aug 10 00:37:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:37:57 user nova-compute[73029]: INFO nova.compute.manager [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Took 12.13 seconds to build instance.
Aug 10 00:37:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8ceecd5e-7298-4f67-8011-f5b384442fa0 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.234s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFtUTiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:38:01 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:38:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:38:01 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:38:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:38:01 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[920da3a9-bc4a-409c-9f30-b273e078da96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:38:01 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd4c5a6-3856-467c-b8be-495dad225b68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f] added
Aug 10 00:38:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b359dc-a4c6-488c-93df-8f3a386b2317]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e119ce1-46ea-4265-aec2-d9cb7c52c4d9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcFtUTiG {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcFtUTiG" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cd573e-0c84-4105-b787-2ec59aa6bc10]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JcFtUTiG'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a865d9d7-06e7-4e16-9326-4810ac01abb6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e75360-07fe-46a0-a2db-1d3e90ab966b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dc751e-be65-414a-81d2-a62de3a0cd8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f, portal: 172.16.0.220,3260]
Aug 10 00:38:02 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f, portal: 172.16.0.220,3260] successful.
Aug 10 00:38:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a729644-272e-4da7-888b-5ee8ecd9b1d5]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66e2a4b-ed92-43ad-bbfc-f12a9d75c278]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:02 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8833bcfe-2c1f-45df-bb60-caf7cf55a146]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFtUTiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:38:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26234343663623338', 'path': '/dev/sdi'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234343663623338', 'path': '/dev/sdi'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG nova.objects.instance [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lazy-loading 'flavor' on Instance uuid 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:38:03 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:38:03 user nova-compute[73029]:   <source dev="/dev/sdi"/>
Aug 10 00:38:03 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:38:03 user nova-compute[73029]:   <serial>a610dbda-d973-468c-b19b-c4ac7542765f</serial>
Aug 10 00:38:03 user nova-compute[73029]: </disk>
Aug 10 00:38:03 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iaqMIOch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:38:03 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:38:03 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:38:03 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6294c06e-6757-421d-8ff2-39412b6d4d47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:38:03 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[240a7f99-5872-4b4a-944f-73ab06194699]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354] added
Aug 10 00:38:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[65418b18-1e02-4c35-97b2-263c93dab514]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[007ab857-0f18-4a0e-bd34-d7f132ac318f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iaqMIOch {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iaqMIOch" returned: 0 in 0.046s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee72fbc-c3b9-410e-9816-a9f7b0edd503]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iaqMIOch'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] No BDM found with device name hda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] No VIF found with MAC fa:16:3e:d0:f6:08, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[410caf48-1478-4922-af8d-0df933394b39]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4f25a3-a672-4998-938b-4505c92d3792]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd94eef1-8e0d-465f-9148-a9b7f4a950fe tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.327s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac32bfd2-df80-4f7a-bdda-410c59f1b929]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354, portal: 172.16.0.220,3260]
Aug 10 00:38:03 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354, portal: 172.16.0.220,3260] successful.
Aug 10 00:38:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5a9f40-9896-4f57-952e-5aa8a6bdcb7c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[012955b3-58dc-4d9d-9470-0c5865072551]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:03 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:38:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[80990ede-eed5-4d17-99a0-7e1eddc2a66e]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:04 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iaqMIOch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23964353735313731', 'path': '/dev/sdj'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964353735313731', 'path': '/dev/sdj'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.objects.instance [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lazy-loading 'flavor' on Instance uuid 68b798ae-944c-40f4-9747-79d60e9bf6ee {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:38:05 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:38:05 user nova-compute[73029]:   <source dev="/dev/sdj"/>
Aug 10 00:38:05 user nova-compute[73029]:   <target dev="sdc" bus="scsi"/>
Aug 10 00:38:05 user nova-compute[73029]:   <serial>f6a4cb74-3db5-4902-a25a-49b819c3a354</serial>
Aug 10 00:38:05 user nova-compute[73029]:   <address type="drive" controller="0" unit="2"/>
Aug 10 00:38:05 user nova-compute[73029]: </disk>
Aug 10 00:38:05 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] No BDM found with device name sda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] No VIF found with MAC fa:16:3e:3f:b4:36, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-65ac18e0-bfdd-4701-a109-0f5e882217eb tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.876s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:05 user nova-compute[73029]: INFO nova.compute.manager [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Detaching volume a610dbda-d973-468c-b19b-c4ac7542765f
Aug 10 00:38:05 user nova-compute[73029]: INFO nova.virt.block_device [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Attempting to driver detach volume a610dbda-d973-468c-b19b-c4ac7542765f from mountpoint /dev/vdb
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Attempting to detach device vdb from instance 118963ea-d3cf-4c10-945f-4718a02412c1 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:38:05 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:38:05 user nova-compute[73029]:   <source dev="/dev/sdi"/>
Aug 10 00:38:05 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:38:05 user nova-compute[73029]:   <serial>a610dbda-d973-468c-b19b-c4ac7542765f</serial>
Aug 10 00:38:05 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 10 00:38:05 user nova-compute[73029]: </disk>
Aug 10 00:38:05 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:38:05 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Successfully detached device vdb from instance 118963ea-d3cf-4c10-945f-4718a02412c1 from the persistent domain config.
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 118963ea-d3cf-4c10-945f-4718a02412c1 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:38:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:38:05 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:38:05 user nova-compute[73029]:   <source dev="/dev/sdi"/>
Aug 10 00:38:05 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:38:05 user nova-compute[73029]:   <serial>a610dbda-d973-468c-b19b-c4ac7542765f</serial>
Aug 10 00:38:05 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 10 00:38:05 user nova-compute[73029]: </disk>
Aug 10 00:38:05 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691627886.302803, 118963ea-d3cf-4c10-945f-4718a02412c1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:38:06 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Successfully detached device vdb from instance 118963ea-d3cf-4c10-945f-4718a02412c1 from the live domain config.
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFtUTiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:38:06 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dad0912-3e1a-4d4b-8624-2a3e6b569f06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: INFO nova.compute.manager [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Detaching volume f6a4cb74-3db5-4902-a25a-49b819c3a354
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb0010c-9d08-413a-86f5-9d05bdae7812]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7528d5a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f'): ({'sdi'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Removing single pathed devices sdi {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b51cb0-c98f-4994-b2b1-4d589d685f4f]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128b79d-0985-4b3c-a9fa-f6084ece8e2c]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Flushing IO for device /dev/sdi {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:38:06 user nova-compute[73029]: INFO nova.virt.block_device [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Attempting to driver detach volume f6a4cb74-3db5-4902-a25a-49b819c3a354 from mountpoint /dev/sdc
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbad1f98-ddac-46a1-9974-3968a032b765]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Attempting to detach device sdc from instance 68b798ae-944c-40f4-9747-79d60e9bf6ee from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:38:06 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:38:06 user nova-compute[73029]:   <source dev="/dev/sdj"/>
Aug 10 00:38:06 user nova-compute[73029]:   <target dev="sdc" bus="scsi"/>
Aug 10 00:38:06 user nova-compute[73029]:   <serial>f6a4cb74-3db5-4902-a25a-49b819c3a354</serial>
Aug 10 00:38:06 user nova-compute[73029]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 10 00:38:06 user nova-compute[73029]: </disk>
Aug 10 00:38:06 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:38:06 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Successfully detached device sdc from instance 68b798ae-944c-40f4-9747-79d60e9bf6ee from the persistent domain config.
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 68b798ae-944c-40f4-9747-79d60e9bf6ee from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:38:06 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:38:06 user nova-compute[73029]:   <source dev="/dev/sdj"/>
Aug 10 00:38:06 user nova-compute[73029]:   <target dev="sdc" bus="scsi"/>
Aug 10 00:38:06 user nova-compute[73029]:   <serial>f6a4cb74-3db5-4902-a25a-49b819c3a354</serial>
Aug 10 00:38:06 user nova-compute[73029]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 10 00:38:06 user nova-compute[73029]: </disk>
Aug 10 00:38:06 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[517774b8-ecef-4b88-a7b9-9ebdf7e4fbcf]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] SCSI volumes sdi have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc9b343-56f4-4a90-8eb5-c6ceaab3f845]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eefbf86-15a0-4a90-89aa-eb00fba188f3]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f, portal: 172.16.0.220,3260]
Aug 10 00:38:06 user nova-compute[73029]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f, portal: 172.16.0.220,3260] successful.
Aug 10 00:38:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a610dbda-d973-468c-b19b-c4ac7542765f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c497531c-2df3-4da0-9c91-33606f619163]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] <== disconnect_volume: return (397ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 68b798ae-944c-40f4-9747-79d60e9bf6ee {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691627886.8805585, 68b798ae-944c-40f4-9747-79d60e9bf6ee => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:38:06 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Successfully detached device sdc from instance 68b798ae-944c-40f4-9747-79d60e9bf6ee from the live domain config.
Aug 10 00:38:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iaqMIOch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:38:06 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f2f07b-a014-48e4-8be1-0434d52f2703]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e094a258-67b0-4230-ad4b-7704d972ac59]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:06 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7528d59750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354'): ({'sdj'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Removing single pathed devices sdj {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a634751-3785-4334-8716-f063ffff3af4]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccec4d0-f2ed-4022-a766-4eb191897d76]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Flushing IO for device /dev/sdj {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[faafce7b-ee5f-4978-8269-ad5e4173b8b9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53033b9-026e-4a16-8054-103a4cb45306]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] SCSI volumes sdj have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ca7c2c-924b-4bac-9e7b-1d23b7476afd]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b12fcb0-6d69-4c6f-8bc5-fae45a2b5c39]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354, portal: 172.16.0.220,3260]
Aug 10 00:38:07 user nova-compute[73029]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354, portal: 172.16.0.220,3260] successful.
Aug 10 00:38:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a4cb74-3db5-4902-a25a-49b819c3a354 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[524fe1a0-0f3d-4802-8342-2df5339f56e4]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] <== disconnect_volume: return (370ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lazy-loading 'flavor' on Instance uuid 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f41e8817-1913-4909-a645-5141107e5a3c tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.190s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "interface-118963ea-d3cf-4c10-945f-4718a02412c1-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "interface-118963ea-d3cf-4c10-945f-4718a02412c1-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lazy-loading 'flavor' on Instance uuid 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-352229283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-352229283',id=7,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSQZlX8tI3HUwW5UVA7H4kJ0KQcIp1DOQA6cc1Hg9qny8FShjYMyHMG2A1DuZmIP9gEfAxzEQzKQ18gbQeFKmztjw82TU4PUw9XXXpr4uKfgwEa89ahnNeAGiXSbMh7qA==',key_name='tempest-keypair-1362690543',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db8942a3a3544a2dac7a3a89a864dd0b',ramdisk_id='',reservation_id='r-yhqgxnwe',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1142167359',owner_user_name='tempest-TaggedAttachmentsTest-1142167359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b480acf3baa421ba056043c717e942f',uuid=118963ea-d3cf-4c10-945f-4718a02412c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converting VIF {"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:68,bridge_name='br-int',has_traffic_filtering=True,id=8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5,network=Network(3d377ef4-f77f-4e34-8344-582a4d219625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dcc9fd9-8b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:87:68"/><model type="virtio"/><mtu size="1442"/><target dev="tap8dcc9fd9-8b"/></interface> {{(pid=73029) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:87:68"/><model type="virtio"/><mtu size="1442"/><target dev="tap8dcc9fd9-8b"/></interface> {{(pid=73029) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Attempting to detach device tap8dcc9fd9-8b from instance 118963ea-d3cf-4c10-945f-4718a02412c1 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] detach device xml: <interface type="ethernet">
Aug 10 00:38:08 user nova-compute[73029]:   <mac address="fa:16:3e:38:87:68"/>
Aug 10 00:38:08 user nova-compute[73029]:   <model type="virtio"/>
Aug 10 00:38:08 user nova-compute[73029]:   <mtu size="1442"/>
Aug 10 00:38:08 user nova-compute[73029]:   <target dev="tap8dcc9fd9-8b"/>
Aug 10 00:38:08 user nova-compute[73029]: </interface>
Aug 10 00:38:08 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:87:68"/><model type="virtio"/><mtu size="1442"/><target dev="tap8dcc9fd9-8b"/></interface> {{(pid=73029) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:87:68"/><model type="virtio"/><mtu size="1442"/><target dev="tap8dcc9fd9-8b"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 10 00:38:08 user nova-compute[73029]:   <name>instance-00000007</name>
Aug 10 00:38:08 user nova-compute[73029]:   <uuid>118963ea-d3cf-4c10-945f-4718a02412c1</uuid>
Aug 10 00:38:08 user nova-compute[73029]:   <metadata>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:38:08 user nova-compute[73029]:   <nova:package version="0.0.0"/>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:name>tempest-device-tagging-server-352229283</nova:name>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:creationTime>2023-08-10 00:37:49</nova:creationTime>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:flavor name="m1.tiny">
Aug 10 00:38:08 user nova-compute[73029]:     <nova:memory>512</nova:memory>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:disk>1</nova:disk>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:swap>0</nova:swap>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:vcpus>1</nova:vcpus>
Aug 10 00:38:08 user nova-compute[73029]:   </nova:flavor>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:owner>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:user uuid="9b480acf3baa421ba056043c717e942f">tempest-TaggedAttachmentsTest-1142167359-project-member</nova:user>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:project uuid="db8942a3a3544a2dac7a3a89a864dd0b">tempest-TaggedAttachmentsTest-1142167359</nova:project>
Aug 10 00:38:08 user nova-compute[73029]:   </nova:owner>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:ports>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:port uuid="05000558-c8bc-4dfc-b4de-5debccaa24fe">
Aug 10 00:38:08 user nova-compute[73029]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 00:38:08 user nova-compute[73029]:     </nova:port>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:port uuid="8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5">
Aug 10 00:38:08 user nova-compute[73029]:       <nova:ip type="fixed" address="10.10.10.78" ipVersion="4"/>
Aug 10 00:38:08 user nova-compute[73029]:     </nova:port>
Aug 10 00:38:08 user nova-compute[73029]:   </nova:ports>
Aug 10 00:38:08 user nova-compute[73029]: </nova:instance>
Aug 10 00:38:08 user nova-compute[73029]:   </metadata>
Aug 10 00:38:08 user nova-compute[73029]:   <memory unit='KiB'>524288</memory>
Aug 10 00:38:08 user nova-compute[73029]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 10 00:38:08 user nova-compute[73029]:   <vcpu placement='static'>1</vcpu>
Aug 10 00:38:08 user nova-compute[73029]:   <resource>
Aug 10 00:38:08 user nova-compute[73029]:     <partition>/machine</partition>
Aug 10 00:38:08 user nova-compute[73029]:   </resource>
Aug 10 00:38:08 user nova-compute[73029]:   <sysinfo type='smbios'>
Aug 10 00:38:08 user nova-compute[73029]:     <system>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='product'>OpenStack Nova</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='version'>0.0.0</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='serial'>118963ea-d3cf-4c10-945f-4718a02412c1</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='uuid'>118963ea-d3cf-4c10-945f-4718a02412c1</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='family'>Virtual Machine</entry>
Aug 10 00:38:08 user nova-compute[73029]:     </system>
Aug 10 00:38:08 user nova-compute[73029]:   </sysinfo>
Aug 10 00:38:08 user nova-compute[73029]:   <os>
Aug 10 00:38:08 user nova-compute[73029]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 10 00:38:08 user nova-compute[73029]:     <boot dev='hd'/>
Aug 10 00:38:08 user nova-compute[73029]:     <smbios mode='sysinfo'/>
Aug 10 00:38:08 user nova-compute[73029]:   </os>
Aug 10 00:38:08 user nova-compute[73029]:   <features>
Aug 10 00:38:08 user nova-compute[73029]:     <acpi/>
Aug 10 00:38:08 user nova-compute[73029]:     <apic/>
Aug 10 00:38:08 user nova-compute[73029]:     <vmcoreinfo state='on'/>
Aug 10 00:38:08 user nova-compute[73029]:   </features>
Aug 10 00:38:08 user nova-compute[73029]:   <cpu mode='custom' match='exact' check='full'>
Aug 10 00:38:08 user nova-compute[73029]:     <model fallback='forbid'>Nehalem</model>
Aug 10 00:38:08 user nova-compute[73029]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 10 00:38:08 user nova-compute[73029]:     <feature policy='require' name='vme'/>
Aug 10 00:38:08 user nova-compute[73029]:     <feature policy='require' name='x2apic'/>
Aug 10 00:38:08 user nova-compute[73029]:     <feature policy='require' name='hypervisor'/>
Aug 10 00:38:08 user nova-compute[73029]:   </cpu>
Aug 10 00:38:08 user nova-compute[73029]:   <clock offset='utc'>
Aug 10 00:38:08 user nova-compute[73029]:     <timer name='pit' tickpolicy='delay'/>
Aug 10 00:38:08 user nova-compute[73029]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 10 00:38:08 user nova-compute[73029]:     <timer name='hpet' present='no'/>
Aug 10 00:38:08 user nova-compute[73029]:   </clock>
Aug 10 00:38:08 user nova-compute[73029]:   <on_poweroff>destroy</on_poweroff>
Aug 10 00:38:08 user nova-compute[73029]:   <on_reboot>restart</on_reboot>
Aug 10 00:38:08 user nova-compute[73029]:   <on_crash>destroy</on_crash>
Aug 10 00:38:08 user nova-compute[73029]:   <devices>
Aug 10 00:38:08 user nova-compute[73029]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 10 00:38:08 user nova-compute[73029]:     <disk type='file' device='disk'>
Aug 10 00:38:08 user nova-compute[73029]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 10 00:38:08 user nova-compute[73029]:       <source file='/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk' index='2'/>
Aug 10 00:38:08 user nova-compute[73029]:       <backingStore type='file' index='3'>
Aug 10 00:38:08 user nova-compute[73029]:         <format type='raw'/>
Aug 10 00:38:08 user nova-compute[73029]:         <source file='/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf'/>
Aug 10 00:38:08 user nova-compute[73029]:         <backingStore/>
Aug 10 00:38:08 user nova-compute[73029]:       </backingStore>
Aug 10 00:38:08 user nova-compute[73029]:       <target dev='vda' bus='virtio'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='virtio-disk0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </disk>
Aug 10 00:38:08 user nova-compute[73029]:     <disk type='file' device='cdrom'>
Aug 10 00:38:08 user nova-compute[73029]:       <driver name='qemu' type='raw' cache='none'/>
Aug 10 00:38:08 user nova-compute[73029]:       <source file='/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk.config' index='1'/>
Aug 10 00:38:08 user nova-compute[73029]:       <backingStore/>
Aug 10 00:38:08 user nova-compute[73029]:       <target dev='hda' bus='ide'/>
Aug 10 00:38:08 user nova-compute[73029]:       <readonly/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='ide0-0-0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </disk>
Aug 10 00:38:08 user nova-compute[73029]:     <controller type='usb' index='0' model='none'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='usb'/>
Aug 10 00:38:08 user nova-compute[73029]:     </controller>
Aug 10 00:38:08 user nova-compute[73029]:     <controller type='pci' index='0' model='pci-root'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='pci.0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </controller>
Aug 10 00:38:08 user nova-compute[73029]:     <controller type='ide' index='0'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='ide'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 10 00:38:08 user nova-compute[73029]:     </controller>
Aug 10 00:38:08 user nova-compute[73029]:     <interface type='ethernet'>
Aug 10 00:38:08 user nova-compute[73029]:       <mac address='fa:16:3e:d0:f6:08'/>
Aug 10 00:38:08 user nova-compute[73029]:       <target dev='tap05000558-c8'/>
Aug 10 00:38:08 user nova-compute[73029]:       <model type='virtio'/>
Aug 10 00:38:08 user nova-compute[73029]:       <mtu size='1442'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='net0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </interface>
Aug 10 00:38:08 user nova-compute[73029]:     <interface type='ethernet'>
Aug 10 00:38:08 user nova-compute[73029]:       <mac address='fa:16:3e:38:87:68'/>
Aug 10 00:38:08 user nova-compute[73029]:       <target dev='tap8dcc9fd9-8b'/>
Aug 10 00:38:08 user nova-compute[73029]:       <model type='virtio'/>
Aug 10 00:38:08 user nova-compute[73029]:       <mtu size='1442'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='net1'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </interface>
Aug 10 00:38:08 user nova-compute[73029]:     <serial type='pty'>
Aug 10 00:38:08 user nova-compute[73029]:       <source path='/dev/pts/6'/>
Aug 10 00:38:08 user nova-compute[73029]:       <log file='/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/console.log' append='off'/>
Aug 10 00:38:08 user nova-compute[73029]:       <target type='isa-serial' port='0'>
Aug 10 00:38:08 user nova-compute[73029]:         <model name='isa-serial'/>
Aug 10 00:38:08 user nova-compute[73029]:       </target>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='serial0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </serial>
Aug 10 00:38:08 user nova-compute[73029]:     <console type='pty' tty='/dev/pts/6'>
Aug 10 00:38:08 user nova-compute[73029]:       <source path='/dev/pts/6'/>
Aug 10 00:38:08 user nova-compute[73029]:       <log file='/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/console.log' append='off'/>
Aug 10 00:38:08 user nova-compute[73029]:       <target type='serial' port='0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='serial0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </console>
Aug 10 00:38:08 user nova-compute[73029]:     <input type='mouse' bus='ps2'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='input0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </input>
Aug 10 00:38:08 user nova-compute[73029]:     <input type='keyboard' bus='ps2'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='input1'/>
Aug 10 00:38:08 user nova-compute[73029]:     </input>
Aug 10 00:38:08 user nova-compute[73029]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 10 00:38:08 user nova-compute[73029]:       <listen type='address' address='0.0.0.0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </graphics>
Aug 10 00:38:08 user nova-compute[73029]:     <audio id='1' type='none'/>
Aug 10 00:38:08 user nova-compute[73029]:     <video>
Aug 10 00:38:08 user nova-compute[73029]:       <model type='virtio' heads='1' primary='yes'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='video0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </video>
Aug 10 00:38:08 user nova-compute[73029]:     <memballoon model='virtio'>
Aug 10 00:38:08 user nova-compute[73029]:       <stats period='10'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='balloon0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </memballoon>
Aug 10 00:38:08 user nova-compute[73029]:     <rng model='virtio'>
Aug 10 00:38:08 user nova-compute[73029]:       <backend model='random'>/dev/urandom</backend>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='rng0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </rng>
Aug 10 00:38:08 user nova-compute[73029]:   </devices>
Aug 10 00:38:08 user nova-compute[73029]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 10 00:38:08 user nova-compute[73029]:     <label>libvirt-118963ea-d3cf-4c10-945f-4718a02412c1</label>
Aug 10 00:38:08 user nova-compute[73029]:     <imagelabel>libvirt-118963ea-d3cf-4c10-945f-4718a02412c1</imagelabel>
Aug 10 00:38:08 user nova-compute[73029]:   </seclabel>
Aug 10 00:38:08 user nova-compute[73029]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 10 00:38:08 user nova-compute[73029]:     <label>+64055:+108</label>
Aug 10 00:38:08 user nova-compute[73029]:     <imagelabel>+64055:+108</imagelabel>
Aug 10 00:38:08 user nova-compute[73029]:   </seclabel>
Aug 10 00:38:08 user nova-compute[73029]: </domain>
Aug 10 00:38:08 user nova-compute[73029]:  {{(pid=73029) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 10 00:38:08 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Successfully detached device tap8dcc9fd9-8b from instance 118963ea-d3cf-4c10-945f-4718a02412c1 from the persistent domain config.
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] (1/8): Attempting to detach device tap8dcc9fd9-8b with device alias net1 from instance 118963ea-d3cf-4c10-945f-4718a02412c1 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] detach device xml: <interface type="ethernet">
Aug 10 00:38:08 user nova-compute[73029]:   <mac address="fa:16:3e:38:87:68"/>
Aug 10 00:38:08 user nova-compute[73029]:   <model type="virtio"/>
Aug 10 00:38:08 user nova-compute[73029]:   <mtu size="1442"/>
Aug 10 00:38:08 user nova-compute[73029]:   <target dev="tap8dcc9fd9-8b"/>
Aug 10 00:38:08 user nova-compute[73029]: </interface>
Aug 10 00:38:08 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lazy-loading 'flavor' on Instance uuid 68b798ae-944c-40f4-9747-79d60e9bf6ee {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-464f8dc5-faf6-4038-a55f-df584b0d03ad tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.838s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691627888.3875508, 118963ea-d3cf-4c10-945f-4718a02412c1 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Start waiting for the detach event from libvirt for device tap8dcc9fd9-8b with device alias net1 for instance 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:87:68"/><model type="virtio"/><mtu size="1442"/><target dev="tap8dcc9fd9-8b"/></interface> {{(pid=73029) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:87:68"/><model type="virtio"/><mtu size="1442"/><target dev="tap8dcc9fd9-8b"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 10 00:38:08 user nova-compute[73029]:   <name>instance-00000007</name>
Aug 10 00:38:08 user nova-compute[73029]:   <uuid>118963ea-d3cf-4c10-945f-4718a02412c1</uuid>
Aug 10 00:38:08 user nova-compute[73029]:   <metadata>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:38:08 user nova-compute[73029]:   <nova:package version="0.0.0"/>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:name>tempest-device-tagging-server-352229283</nova:name>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:creationTime>2023-08-10 00:37:49</nova:creationTime>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:flavor name="m1.tiny">
Aug 10 00:38:08 user nova-compute[73029]:     <nova:memory>512</nova:memory>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:disk>1</nova:disk>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:swap>0</nova:swap>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:vcpus>1</nova:vcpus>
Aug 10 00:38:08 user nova-compute[73029]:   </nova:flavor>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:owner>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:user uuid="9b480acf3baa421ba056043c717e942f">tempest-TaggedAttachmentsTest-1142167359-project-member</nova:user>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:project uuid="db8942a3a3544a2dac7a3a89a864dd0b">tempest-TaggedAttachmentsTest-1142167359</nova:project>
Aug 10 00:38:08 user nova-compute[73029]:   </nova:owner>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:ports>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:port uuid="05000558-c8bc-4dfc-b4de-5debccaa24fe">
Aug 10 00:38:08 user nova-compute[73029]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 00:38:08 user nova-compute[73029]:     </nova:port>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:port uuid="8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5">
Aug 10 00:38:08 user nova-compute[73029]:       <nova:ip type="fixed" address="10.10.10.78" ipVersion="4"/>
Aug 10 00:38:08 user nova-compute[73029]:     </nova:port>
Aug 10 00:38:08 user nova-compute[73029]:   </nova:ports>
Aug 10 00:38:08 user nova-compute[73029]: </nova:instance>
Aug 10 00:38:08 user nova-compute[73029]:   </metadata>
Aug 10 00:38:08 user nova-compute[73029]:   <memory unit='KiB'>524288</memory>
Aug 10 00:38:08 user nova-compute[73029]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 10 00:38:08 user nova-compute[73029]:   <vcpu placement='static'>1</vcpu>
Aug 10 00:38:08 user nova-compute[73029]:   <resource>
Aug 10 00:38:08 user nova-compute[73029]:     <partition>/machine</partition>
Aug 10 00:38:08 user nova-compute[73029]:   </resource>
Aug 10 00:38:08 user nova-compute[73029]:   <sysinfo type='smbios'>
Aug 10 00:38:08 user nova-compute[73029]:     <system>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='product'>OpenStack Nova</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='version'>0.0.0</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='serial'>118963ea-d3cf-4c10-945f-4718a02412c1</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='uuid'>118963ea-d3cf-4c10-945f-4718a02412c1</entry>
Aug 10 00:38:08 user nova-compute[73029]:       <entry name='family'>Virtual Machine</entry>
Aug 10 00:38:08 user nova-compute[73029]:     </system>
Aug 10 00:38:08 user nova-compute[73029]:   </sysinfo>
Aug 10 00:38:08 user nova-compute[73029]:   <os>
Aug 10 00:38:08 user nova-compute[73029]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 10 00:38:08 user nova-compute[73029]:     <boot dev='hd'/>
Aug 10 00:38:08 user nova-compute[73029]:     <smbios mode='sysinfo'/>
Aug 10 00:38:08 user nova-compute[73029]:   </os>
Aug 10 00:38:08 user nova-compute[73029]:   <features>
Aug 10 00:38:08 user nova-compute[73029]:     <acpi/>
Aug 10 00:38:08 user nova-compute[73029]:     <apic/>
Aug 10 00:38:08 user nova-compute[73029]:     <vmcoreinfo state='on'/>
Aug 10 00:38:08 user nova-compute[73029]:   </features>
Aug 10 00:38:08 user nova-compute[73029]:   <cpu mode='custom' match='exact' check='full'>
Aug 10 00:38:08 user nova-compute[73029]:     <model fallback='forbid'>Nehalem</model>
Aug 10 00:38:08 user nova-compute[73029]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 10 00:38:08 user nova-compute[73029]:     <feature policy='require' name='vme'/>
Aug 10 00:38:08 user nova-compute[73029]:     <feature policy='require' name='x2apic'/>
Aug 10 00:38:08 user nova-compute[73029]:     <feature policy='require' name='hypervisor'/>
Aug 10 00:38:08 user nova-compute[73029]:   </cpu>
Aug 10 00:38:08 user nova-compute[73029]:   <clock offset='utc'>
Aug 10 00:38:08 user nova-compute[73029]:     <timer name='pit' tickpolicy='delay'/>
Aug 10 00:38:08 user nova-compute[73029]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 10 00:38:08 user nova-compute[73029]:     <timer name='hpet' present='no'/>
Aug 10 00:38:08 user nova-compute[73029]:   </clock>
Aug 10 00:38:08 user nova-compute[73029]:   <on_poweroff>destroy</on_poweroff>
Aug 10 00:38:08 user nova-compute[73029]:   <on_reboot>restart</on_reboot>
Aug 10 00:38:08 user nova-compute[73029]:   <on_crash>destroy</on_crash>
Aug 10 00:38:08 user nova-compute[73029]:   <devices>
Aug 10 00:38:08 user nova-compute[73029]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 10 00:38:08 user nova-compute[73029]:     <disk type='file' device='disk'>
Aug 10 00:38:08 user nova-compute[73029]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 10 00:38:08 user nova-compute[73029]:       <source file='/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk' index='2'/>
Aug 10 00:38:08 user nova-compute[73029]:       <backingStore type='file' index='3'>
Aug 10 00:38:08 user nova-compute[73029]:         <format type='raw'/>
Aug 10 00:38:08 user nova-compute[73029]:         <source file='/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf'/>
Aug 10 00:38:08 user nova-compute[73029]:         <backingStore/>
Aug 10 00:38:08 user nova-compute[73029]:       </backingStore>
Aug 10 00:38:08 user nova-compute[73029]:       <target dev='vda' bus='virtio'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='virtio-disk0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </disk>
Aug 10 00:38:08 user nova-compute[73029]:     <disk type='file' device='cdrom'>
Aug 10 00:38:08 user nova-compute[73029]:       <driver name='qemu' type='raw' cache='none'/>
Aug 10 00:38:08 user nova-compute[73029]:       <source file='/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk.config' index='1'/>
Aug 10 00:38:08 user nova-compute[73029]:       <backingStore/>
Aug 10 00:38:08 user nova-compute[73029]:       <target dev='hda' bus='ide'/>
Aug 10 00:38:08 user nova-compute[73029]:       <readonly/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='ide0-0-0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </disk>
Aug 10 00:38:08 user nova-compute[73029]:     <controller type='usb' index='0' model='none'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='usb'/>
Aug 10 00:38:08 user nova-compute[73029]:     </controller>
Aug 10 00:38:08 user nova-compute[73029]:     <controller type='pci' index='0' model='pci-root'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='pci.0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </controller>
Aug 10 00:38:08 user nova-compute[73029]:     <controller type='ide' index='0'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='ide'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 10 00:38:08 user nova-compute[73029]:     </controller>
Aug 10 00:38:08 user nova-compute[73029]:     <interface type='ethernet'>
Aug 10 00:38:08 user nova-compute[73029]:       <mac address='fa:16:3e:d0:f6:08'/>
Aug 10 00:38:08 user nova-compute[73029]:       <target dev='tap05000558-c8'/>
Aug 10 00:38:08 user nova-compute[73029]:       <model type='virtio'/>
Aug 10 00:38:08 user nova-compute[73029]:       <mtu size='1442'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='net0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </interface>
Aug 10 00:38:08 user nova-compute[73029]:     <serial type='pty'>
Aug 10 00:38:08 user nova-compute[73029]:       <source path='/dev/pts/6'/>
Aug 10 00:38:08 user nova-compute[73029]:       <log file='/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/console.log' append='off'/>
Aug 10 00:38:08 user nova-compute[73029]:       <target type='isa-serial' port='0'>
Aug 10 00:38:08 user nova-compute[73029]:         <model name='isa-serial'/>
Aug 10 00:38:08 user nova-compute[73029]:       </target>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='serial0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </serial>
Aug 10 00:38:08 user nova-compute[73029]:     <console type='pty' tty='/dev/pts/6'>
Aug 10 00:38:08 user nova-compute[73029]:       <source path='/dev/pts/6'/>
Aug 10 00:38:08 user nova-compute[73029]:       <log file='/opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/console.log' append='off'/>
Aug 10 00:38:08 user nova-compute[73029]:       <target type='serial' port='0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='serial0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </console>
Aug 10 00:38:08 user nova-compute[73029]:     <input type='mouse' bus='ps2'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='input0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </input>
Aug 10 00:38:08 user nova-compute[73029]:     <input type='keyboard' bus='ps2'>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='input1'/>
Aug 10 00:38:08 user nova-compute[73029]:     </input>
Aug 10 00:38:08 user nova-compute[73029]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 10 00:38:08 user nova-compute[73029]:       <listen type='address' address='0.0.0.0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </graphics>
Aug 10 00:38:08 user nova-compute[73029]:     <audio id='1' type='none'/>
Aug 10 00:38:08 user nova-compute[73029]:     <video>
Aug 10 00:38:08 user nova-compute[73029]:       <model type='virtio' heads='1' primary='yes'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='video0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </video>
Aug 10 00:38:08 user nova-compute[73029]:     <memballoon model='virtio'>
Aug 10 00:38:08 user nova-compute[73029]:       <stats period='10'/>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='balloon0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </memballoon>
Aug 10 00:38:08 user nova-compute[73029]:     <rng model='virtio'>
Aug 10 00:38:08 user nova-compute[73029]:       <backend model='random'>/dev/urandom</backend>
Aug 10 00:38:08 user nova-compute[73029]:       <alias name='rng0'/>
Aug 10 00:38:08 user nova-compute[73029]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 10 00:38:08 user nova-compute[73029]:     </rng>
Aug 10 00:38:08 user nova-compute[73029]:   </devices>
Aug 10 00:38:08 user nova-compute[73029]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 10 00:38:08 user nova-compute[73029]:     <label>libvirt-118963ea-d3cf-4c10-945f-4718a02412c1</label>
Aug 10 00:38:08 user nova-compute[73029]:     <imagelabel>libvirt-118963ea-d3cf-4c10-945f-4718a02412c1</imagelabel>
Aug 10 00:38:08 user nova-compute[73029]:   </seclabel>
Aug 10 00:38:08 user nova-compute[73029]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 10 00:38:08 user nova-compute[73029]:     <label>+64055:+108</label>
Aug 10 00:38:08 user nova-compute[73029]:     <imagelabel>+64055:+108</imagelabel>
Aug 10 00:38:08 user nova-compute[73029]:   </seclabel>
Aug 10 00:38:08 user nova-compute[73029]: </domain>
Aug 10 00:38:08 user nova-compute[73029]:  {{(pid=73029) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 10 00:38:08 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Successfully detached device tap8dcc9fd9-8b from instance 118963ea-d3cf-4c10-945f-4718a02412c1 from the live domain config.
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-352229283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-352229283',id=7,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSQZlX8tI3HUwW5UVA7H4kJ0KQcIp1DOQA6cc1Hg9qny8FShjYMyHMG2A1DuZmIP9gEfAxzEQzKQ18gbQeFKmztjw82TU4PUw9XXXpr4uKfgwEa89ahnNeAGiXSbMh7qA==',key_name='tempest-keypair-1362690543',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db8942a3a3544a2dac7a3a89a864dd0b',ramdisk_id='',reservation_id='r-yhqgxnwe',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1142167359',owner_user_name='tempest-TaggedAttachmentsTest-1142167359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b480acf3baa421ba056043c717e942f',uuid=118963ea-d3cf-4c10-945f-4718a02412c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converting VIF {"id": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "address": "fa:16:3e:38:87:68", "network": {"id": "3d377ef4-f77f-4e34-8344-582a4d219625", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-649150182", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dcc9fd9-8b", "ovs_interfaceid": "8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:68,bridge_name='br-int',has_traffic_filtering=True,id=8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5,network=Network(3d377ef4-f77f-4e34-8344-582a4d219625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dcc9fd9-8b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG os_vif [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:68,bridge_name='br-int',has_traffic_filtering=True,id=8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5,network=Network(3d377ef4-f77f-4e34-8344-582a4d219625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dcc9fd9-8b') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8dcc9fd9-8b, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:08 user nova-compute[73029]: INFO os_vif [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:87:68,bridge_name='br-int',has_traffic_filtering=True,id=8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5,network=Network(3d377ef4-f77f-4e34-8344-582a4d219625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dcc9fd9-8b')
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:38:08 user nova-compute[73029]:   <nova:package version="0.0.0"/>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:name>tempest-device-tagging-server-352229283</nova:name>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:creationTime>2023-08-10 00:38:08</nova:creationTime>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:flavor name="m1.tiny">
Aug 10 00:38:08 user nova-compute[73029]:     <nova:memory>512</nova:memory>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:disk>1</nova:disk>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:swap>0</nova:swap>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:vcpus>1</nova:vcpus>
Aug 10 00:38:08 user nova-compute[73029]:   </nova:flavor>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:owner>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:user uuid="9b480acf3baa421ba056043c717e942f">tempest-TaggedAttachmentsTest-1142167359-project-member</nova:user>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:project uuid="db8942a3a3544a2dac7a3a89a864dd0b">tempest-TaggedAttachmentsTest-1142167359</nova:project>
Aug 10 00:38:08 user nova-compute[73029]:   </nova:owner>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:38:08 user nova-compute[73029]:   <nova:ports>
Aug 10 00:38:08 user nova-compute[73029]:     <nova:port uuid="05000558-c8bc-4dfc-b4de-5debccaa24fe">
Aug 10 00:38:08 user nova-compute[73029]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 00:38:08 user nova-compute[73029]:     </nova:port>
Aug 10 00:38:08 user nova-compute[73029]:   </nova:ports>
Aug 10 00:38:08 user nova-compute[73029]: </nova:instance>
Aug 10 00:38:08 user nova-compute[73029]:  {{(pid=73029) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-95c70253-0a1b-4423-b9b9-f4fb536d8861 req-4544aacf-545f-49cd-a849-2e1258832a44 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-unplugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-95c70253-0a1b-4423-b9b9-f4fb536d8861 req-4544aacf-545f-49cd-a849-2e1258832a44 service nova] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-95c70253-0a1b-4423-b9b9-f4fb536d8861 req-4544aacf-545f-49cd-a849-2e1258832a44 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-95c70253-0a1b-4423-b9b9-f4fb536d8861 req-4544aacf-545f-49cd-a849-2e1258832a44 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-95c70253-0a1b-4423-b9b9-f4fb536d8861 req-4544aacf-545f-49cd-a849-2e1258832a44 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] No waiting events found dispatching network-vif-unplugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:08 user nova-compute[73029]: WARNING nova.compute.manager [req-95c70253-0a1b-4423-b9b9-f4fb536d8861 req-4544aacf-545f-49cd-a849-2e1258832a44 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received unexpected event network-vif-unplugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 for instance with vm_state active and task_state None.
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:09 user nova-compute[73029]: INFO nova.compute.manager [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Terminating instance
Aug 10 00:38:09 user nova-compute[73029]: DEBUG nova.compute.manager [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquired lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG nova.network.neutron [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-3febf3d5-92cd-4627-b43c-924ba7db40eb req-96bb0f94-25e0-413a-827c-f3c5a0c681b5 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-unplugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3febf3d5-92cd-4627-b43c-924ba7db40eb req-96bb0f94-25e0-413a-827c-f3c5a0c681b5 service nova] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3febf3d5-92cd-4627-b43c-924ba7db40eb req-96bb0f94-25e0-413a-827c-f3c5a0c681b5 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3febf3d5-92cd-4627-b43c-924ba7db40eb req-96bb0f94-25e0-413a-827c-f3c5a0c681b5 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-3febf3d5-92cd-4627-b43c-924ba7db40eb req-96bb0f94-25e0-413a-827c-f3c5a0c681b5 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] No waiting events found dispatching network-vif-unplugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-3febf3d5-92cd-4627-b43c-924ba7db40eb req-96bb0f94-25e0-413a-827c-f3c5a0c681b5 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-unplugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Instance destroyed successfully.
Aug 10 00:38:09 user nova-compute[73029]: DEBUG nova.objects.instance [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lazy-loading 'resources' on Instance uuid 68b798ae-944c-40f4-9747-79d60e9bf6ee {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-168337976',display_name='tempest-AttachSCSIVolumeTestJSON-server-168337976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-168337976',id=8,image_ref='8299476b-1d45-4d53-9a29-947ccb8e20db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyRlDGB9GkKv2QceB/A5gbgez+rMJkMemiLz/eupJ5NKS7KDTk15mSfoXSLRJ2PF3gPBdD4em/hO+rcbJ+SJ5RBLq5/wy6aKtKMeMZcWPUhDqEHXaob5+626BriCNLcjw==',key_name='tempest-keypair-170495231',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:36:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c6605cb164b405ba6654ed17bc106cb',ramdisk_id='',reservation_id='r-fgbse67x',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8299476b-1d45-4d53-9a29-947ccb8e20db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1385797763',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1385797763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:36:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36d1a470fba043808d32340dec8ca7b3',uuid=68b798ae-944c-40f4-9747-79d60e9bf6ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Converting VIF {"id": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "address": "fa:16:3e:3f:b4:36", "network": {"id": "7d6b7e87-27a1-4971-8549-f281f9b6b09d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-124060924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6605cb164b405ba6654ed17bc106cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ffb577-36", "ovs_interfaceid": "70ffb577-36a7-4e12-af57-d8d6afbbd5cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=70ffb577-36a7-4e12-af57-d8d6afbbd5cd,network=Network(7d6b7e87-27a1-4971-8549-f281f9b6b09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ffb577-36') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG os_vif [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=70ffb577-36a7-4e12-af57-d8d6afbbd5cd,network=Network(7d6b7e87-27a1-4971-8549-f281f9b6b09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ffb577-36') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70ffb577-36, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:09 user nova-compute[73029]: INFO os_vif [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=70ffb577-36a7-4e12-af57-d8d6afbbd5cd,network=Network(7d6b7e87-27a1-4971-8549-f281f9b6b09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ffb577-36')
Aug 10 00:38:09 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Deleting instance files /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee_del
Aug 10 00:38:10 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Deletion of /opt/stack/data/nova/instances/68b798ae-944c-40f4-9747-79d60e9bf6ee_del complete
Aug 10 00:38:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:38:10 user nova-compute[73029]: INFO nova.compute.manager [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 10 00:38:10 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:10 user nova-compute[73029]: INFO nova.network.neutron [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Port 8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 10 00:38:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updating instance_info_cache with network_info: [{"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Releasing lock "refresh_cache-118963ea-d3cf-4c10-945f-4718a02412c1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90db73ce-943f-4ffe-ac26-6f327c10dbbc tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "interface-118963ea-d3cf-4c10-945f-4718a02412c1-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.324s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-7cabd9b0-1992-4f44-9964-45557453eb00 req-70365746-a2b3-4848-abb8-d3a9b584b5fc service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-plugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7cabd9b0-1992-4f44-9964-45557453eb00 req-70365746-a2b3-4848-abb8-d3a9b584b5fc service nova] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7cabd9b0-1992-4f44-9964-45557453eb00 req-70365746-a2b3-4848-abb8-d3a9b584b5fc service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7cabd9b0-1992-4f44-9964-45557453eb00 req-70365746-a2b3-4848-abb8-d3a9b584b5fc service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-7cabd9b0-1992-4f44-9964-45557453eb00 req-70365746-a2b3-4848-abb8-d3a9b584b5fc service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] No waiting events found dispatching network-vif-plugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:10 user nova-compute[73029]: WARNING nova.compute.manager [req-7cabd9b0-1992-4f44-9964-45557453eb00 req-70365746-a2b3-4848-abb8-d3a9b584b5fc service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received unexpected event network-vif-plugged-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 for instance with vm_state active and task_state None.
Aug 10 00:38:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-7cabd9b0-1992-4f44-9964-45557453eb00 req-70365746-a2b3-4848-abb8-d3a9b584b5fc service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-deleted-8dcc9fd9-8b0a-46db-83ec-3bcd72fb37f5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] No waiting events found dispatching network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:11 user nova-compute[73029]: WARNING nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received unexpected event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd for instance with vm_state active and task_state deleting.
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] No waiting events found dispatching network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:11 user nova-compute[73029]: WARNING nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received unexpected event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd for instance with vm_state active and task_state deleting.
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] No waiting events found dispatching network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:11 user nova-compute[73029]: WARNING nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received unexpected event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd for instance with vm_state active and task_state deleting.
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-unplugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] No waiting events found dispatching network-vif-unplugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-unplugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Acquiring lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] No waiting events found dispatching network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:11 user nova-compute[73029]: WARNING nova.compute.manager [req-f11a7b48-355b-4f48-bb71-531521c5ae96 req-305c1472-05a6-4a7e-924f-76d744498807 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received unexpected event network-vif-plugged-70ffb577-36a7-4e12-af57-d8d6afbbd5cd for instance with vm_state active and task_state deleting.
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating instance_info_cache with network_info: [{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:38:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:12 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:12 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Took 1.94 seconds to deallocate network for instance.
Aug 10 00:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:12 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:38:12 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:12 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Deleted allocations for instance 68b798ae-944c-40f4-9747-79d60e9bf6ee
Aug 10 00:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3ca15fff-28f7-46d6-875b-6adadc7b95a1 tempest-AttachSCSIVolumeTestJSON-1385797763 tempest-AttachSCSIVolumeTestJSON-1385797763-project-member] Lock "68b798ae-944c-40f4-9747-79d60e9bf6ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.608s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-84a456af-1473-41d9-ab31-0aabaddc8ee2 req-20d0e192-16aa-4494-9bdc-36d6cba6da24 service nova] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Received event network-vif-deleted-70ffb577-36a7-4e12-af57-d8d6afbbd5cd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:38:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquiring lock "37790055-25a9-4304-891e-17ccd8b0f46d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "37790055-25a9-4304-891e-17ccd8b0f46d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquiring lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:14 user nova-compute[73029]: INFO nova.compute.manager [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Terminating instance
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-ed93fc96-430c-4b16-ad93-d13545780abe req-482243b8-7cc2-4d02-91b6-5f1702d7e3e9 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received event network-vif-unplugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ed93fc96-430c-4b16-ad93-d13545780abe req-482243b8-7cc2-4d02-91b6-5f1702d7e3e9 service nova] Acquiring lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ed93fc96-430c-4b16-ad93-d13545780abe req-482243b8-7cc2-4d02-91b6-5f1702d7e3e9 service nova] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ed93fc96-430c-4b16-ad93-d13545780abe req-482243b8-7cc2-4d02-91b6-5f1702d7e3e9 service nova] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-ed93fc96-430c-4b16-ad93-d13545780abe req-482243b8-7cc2-4d02-91b6-5f1702d7e3e9 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] No waiting events found dispatching network-vif-unplugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-ed93fc96-430c-4b16-ad93-d13545780abe req-482243b8-7cc2-4d02-91b6-5f1702d7e3e9 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received event network-vif-unplugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:14 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Instance destroyed successfully.
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.objects.instance [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lazy-loading 'resources' on Instance uuid 37790055-25a9-4304-891e-17ccd8b0f46d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1772786510',display_name='tempest-VolumesActionsTest-instance-1772786510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1772786510',id=9,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:36:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f807e9040ec84d4cbd12b36358d8007d',ramdisk_id='',reservation_id='r-yoxjy5yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1817209675',owner_user_name='tempest-VolumesActionsTest-1817209675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:36:22Z,user_data=None,user_id='3a9bf00a9efe4e068dbc96fdc589610c',uuid=37790055-25a9-4304-891e-17ccd8b0f46d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Converting VIF {"id": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "address": "fa:16:3e:af:83:37", "network": {"id": "7fc118f9-9ad5-46f6-9f36-68db61a1b39d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-113335248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f807e9040ec84d4cbd12b36358d8007d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ddc1b4-0b", "ovs_interfaceid": "98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:37,bridge_name='br-int',has_traffic_filtering=True,id=98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50,network=Network(7fc118f9-9ad5-46f6-9f36-68db61a1b39d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ddc1b4-0b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG os_vif [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:37,bridge_name='br-int',has_traffic_filtering=True,id=98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50,network=Network(7fc118f9-9ad5-46f6-9f36-68db61a1b39d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ddc1b4-0b') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98ddc1b4-0b, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:14 user nova-compute[73029]: INFO os_vif [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:37,bridge_name='br-int',has_traffic_filtering=True,id=98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50,network=Network(7fc118f9-9ad5-46f6-9f36-68db61a1b39d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ddc1b4-0b')
Aug 10 00:38:14 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Deleting instance files /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d_del
Aug 10 00:38:14 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Deletion of /opt/stack/data/nova/instances/37790055-25a9-4304-891e-17ccd8b0f46d_del complete
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:15 user nova-compute[73029]: INFO nova.compute.manager [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG nova.compute.manager [req-3e4dccf8-3791-472a-9658-9f38dda60cae req-127cbc0a-ad1b-4459-8434-2b3d8af4a468 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received event network-vif-deleted-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:15 user nova-compute[73029]: INFO nova.compute.manager [req-3e4dccf8-3791-472a-9658-9f38dda60cae req-127cbc0a-ad1b-4459-8434-2b3d8af4a468 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Neutron deleted interface 98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50; detaching it from the instance and deleting it from the info cache
Aug 10 00:38:15 user nova-compute[73029]: DEBUG nova.network.neutron [req-3e4dccf8-3791-472a-9658-9f38dda60cae req-127cbc0a-ad1b-4459-8434-2b3d8af4a468 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:15 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Took 0.48 seconds to deallocate network for instance.
Aug 10 00:38:15 user nova-compute[73029]: DEBUG nova.compute.manager [req-3e4dccf8-3791-472a-9658-9f38dda60cae req-127cbc0a-ad1b-4459-8434-2b3d8af4a468 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Detach interface failed, port_id=98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50, reason: Instance 37790055-25a9-4304-891e-17ccd8b0f46d could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:15 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid '37790055-25a9-4304-891e-17ccd8b0f46d' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid '37790055-25a9-4304-891e-17ccd8b0f46d' (instance-00000009)
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:16 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Deleted allocations for instance 37790055-25a9-4304-891e-17ccd8b0f46d
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-88422976-f609-4b42-b7d0-d1ce97893c0d tempest-VolumesActionsTest-1817209675 tempest-VolumesActionsTest-1817209675-project-member] Lock "37790055-25a9-4304-891e-17ccd8b0f46d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.995s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-d15fba03-43f3-4d21-aac8-fc5b3f6d378c req-ee93f46f-0a17-4b37-b2c6-b9d5314337a8 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received event network-vif-plugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d15fba03-43f3-4d21-aac8-fc5b3f6d378c req-ee93f46f-0a17-4b37-b2c6-b9d5314337a8 service nova] Acquiring lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d15fba03-43f3-4d21-aac8-fc5b3f6d378c req-ee93f46f-0a17-4b37-b2c6-b9d5314337a8 service nova] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d15fba03-43f3-4d21-aac8-fc5b3f6d378c req-ee93f46f-0a17-4b37-b2c6-b9d5314337a8 service nova] Lock "37790055-25a9-4304-891e-17ccd8b0f46d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-d15fba03-43f3-4d21-aac8-fc5b3f6d378c req-ee93f46f-0a17-4b37-b2c6-b9d5314337a8 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] No waiting events found dispatching network-vif-plugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:16 user nova-compute[73029]: WARNING nova.compute.manager [req-d15fba03-43f3-4d21-aac8-fc5b3f6d378c req-ee93f46f-0a17-4b37-b2c6-b9d5314337a8 service nova] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Received unexpected event network-vif-plugged-98ddc1b4-0b27-4e25-ae5f-1ea1c06fec50 for instance with vm_state deleted and task_state None.
Aug 10 00:38:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:17 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:38:17 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=6520MB free_disk=25.37924575805664GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 118963ea-d3cf-4c10-945f-4718a02412c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 866f4abf-6566-4145-a780-953a4615659c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cc846d6c-027a-4a9a-819f-27919f3d2b25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance dc191a1a-b684-4b2a-8cee-0572a6396b0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f1561416-585d-4d7d-a1d7-86a64cf00630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:38:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-8da74c56-13c0-480e-84da-ad101e01dee9 req-102703f7-77f5-4622-8d42-594ae0316bf5 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-changed-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-8da74c56-13c0-480e-84da-ad101e01dee9 req-102703f7-77f5-4622-8d42-594ae0316bf5 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing instance network info cache due to event network-changed-2fb1bff0-2a76-47ab-89c6-9463f7af33fb. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:38:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8da74c56-13c0-480e-84da-ad101e01dee9 req-102703f7-77f5-4622-8d42-594ae0316bf5 service nova] Acquiring lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:38:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8da74c56-13c0-480e-84da-ad101e01dee9 req-102703f7-77f5-4622-8d42-594ae0316bf5 service nova] Acquired lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:38:24 user nova-compute[73029]: DEBUG nova.network.neutron [req-8da74c56-13c0-480e-84da-ad101e01dee9 req-102703f7-77f5-4622-8d42-594ae0316bf5 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Refreshing network info cache for port 2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:38:24 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627889.915959, 68b798ae-944c-40f4-9747-79d60e9bf6ee => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:38:24 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] VM Stopped (Lifecycle Event)
Aug 10 00:38:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-84dda68e-2925-4bf8-9cc1-a2b3f55abd5b None None] [instance: 68b798ae-944c-40f4-9747-79d60e9bf6ee] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:38:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-8da74c56-13c0-480e-84da-ad101e01dee9 req-102703f7-77f5-4622-8d42-594ae0316bf5 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updated VIF entry in instance network info cache for port 2fb1bff0-2a76-47ab-89c6-9463f7af33fb. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:38:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-8da74c56-13c0-480e-84da-ad101e01dee9 req-102703f7-77f5-4622-8d42-594ae0316bf5 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [{"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8da74c56-13c0-480e-84da-ad101e01dee9 req-102703f7-77f5-4622-8d42-594ae0316bf5 service nova] Releasing lock "refresh_cache-866f4abf-6566-4145-a780-953a4615659c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:38:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "866f4abf-6566-4145-a780-953a4615659c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:27 user nova-compute[73029]: INFO nova.compute.manager [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Terminating instance
Aug 10 00:38:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-d90747a6-5cc8-4083-acc4-e8c9d35c7a8d req-178a7aeb-74d5-463f-8fd2-3d9777878716 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d90747a6-5cc8-4083-acc4-e8c9d35c7a8d req-178a7aeb-74d5-463f-8fd2-3d9777878716 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d90747a6-5cc8-4083-acc4-e8c9d35c7a8d req-178a7aeb-74d5-463f-8fd2-3d9777878716 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d90747a6-5cc8-4083-acc4-e8c9d35c7a8d req-178a7aeb-74d5-463f-8fd2-3d9777878716 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-d90747a6-5cc8-4083-acc4-e8c9d35c7a8d req-178a7aeb-74d5-463f-8fd2-3d9777878716 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-unplugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-d90747a6-5cc8-4083-acc4-e8c9d35c7a8d req-178a7aeb-74d5-463f-8fd2-3d9777878716 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ba296f88-96d9-4b02-924a-18143462edd3 req-61204d98-4aa0-4897-8628-67e34011c6be service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ba296f88-96d9-4b02-924a-18143462edd3 req-61204d98-4aa0-4897-8628-67e34011c6be service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ba296f88-96d9-4b02-924a-18143462edd3 req-61204d98-4aa0-4897-8628-67e34011c6be service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ba296f88-96d9-4b02-924a-18143462edd3 req-61204d98-4aa0-4897-8628-67e34011c6be service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ba296f88-96d9-4b02-924a-18143462edd3 req-61204d98-4aa0-4897-8628-67e34011c6be service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-unplugged-ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ba296f88-96d9-4b02-924a-18143462edd3 req-61204d98-4aa0-4897-8628-67e34011c6be service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-ed246d9b-d91d-40b5-b717-709f504c368d for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 866f4abf-6566-4145-a780-953a4615659c] Instance destroyed successfully.
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lazy-loading 'resources' on Instance uuid 866f4abf-6566-4145-a780-953a4615659c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e3:f1,bridge_name='br-int',has_traffic_filtering=True,id=2fb1bff0-2a76-47ab-89c6-9463f7af33fb,network=Network(5715dc1c-60f7-4b2b-90ea-9957073f1762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fb1bff0-2a') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e3:f1,bridge_name='br-int',has_traffic_filtering=True,id=2fb1bff0-2a76-47ab-89c6-9463f7af33fb,network=Network(5715dc1c-60f7-4b2b-90ea-9957073f1762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fb1bff0-2a') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fb1bff0-2a, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: INFO os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e3:f1,bridge_name='br-int',has_traffic_filtering=True,id=2fb1bff0-2a76-47ab-89c6-9463f7af33fb,network=Network(5715dc1c-60f7-4b2b-90ea-9957073f1762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fb1bff0-2a')
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=ed246d9b-d91d-40b5-b717-709f504c368d,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped246d9b-d9') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=ed246d9b-d91d-40b5-b717-709f504c368d,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped246d9b-d9') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped246d9b-d9, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: INFO os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:43,bridge_name='br-int',has_traffic_filtering=True,id=ed246d9b-d91d-40b5-b717-709f504c368d,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped246d9b-d9')
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=7828acf4-aa6f-4c50-9ef8-54badc35b15f,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7828acf4-aa') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=7828acf4-aa6f-4c50-9ef8-54badc35b15f,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7828acf4-aa') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7828acf4-aa, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: INFO os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=7828acf4-aa6f-4c50-9ef8-54badc35b15f,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7828acf4-aa')
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:87:97,bridge_name='br-int',has_traffic_filtering=True,id=8ea3b562-0cdb-49b5-bc3d-50d6d01198bb,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3b562-0c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:87:97,bridge_name='br-int',has_traffic_filtering=True,id=8ea3b562-0cdb-49b5-bc3d-50d6d01198bb,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3b562-0c') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ea3b562-0c, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: INFO os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:87:97,bridge_name='br-int',has_traffic_filtering=True,id=8ea3b562-0cdb-49b5-bc3d-50d6d01198bb,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3b562-0c')
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "address": "fa:16:3e:76:20:c6", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7c725-4d", "ovs_interfaceid": "7ee7c725-4d8e-4e06-a5a9-2871b750d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=7ee7c725-4d8e-4e06-a5a9-2871b750d499,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7c725-4d') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=7ee7c725-4d8e-4e06-a5a9-2871b750d499,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7c725-4d') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ee7c725-4d, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: INFO os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=7ee7c725-4d8e-4e06-a5a9-2871b750d499,network=Network(08c4af45-333a-41a0-a4c4-c1feef389679),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7c725-4d')
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:3d:f5,bridge_name='br-int',has_traffic_filtering=True,id=014ba0f6-67f6-4eba-ad88-5cc7e48a35fd,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014ba0f6-67') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:3d:f5,bridge_name='br-int',has_traffic_filtering=True,id=014ba0f6-67f6-4eba-ad88-5cc7e48a35fd,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014ba0f6-67') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap014ba0f6-67, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: INFO os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:3d:f5,bridge_name='br-int',has_traffic_filtering=True,id=014ba0f6-67f6-4eba-ad88-5cc7e48a35fd,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014ba0f6-67')
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-925067125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-925067125',id=10,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdTMF0WzZx+K9KZS8hk/xT6GpGEEXFlX70jLr1srzGwYhvH4l5zYe5CVC5xyi8UY/2s1hG+l4qb3L8A6mgV0MB0oQDJ9xrhcaMZo3pGhMPbC4XkwPsSoOnqvOj7Fu+/nA==',key_name='tempest-keypair-1949233150',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb0163154674b4eb8b6116b45917b53',ramdisk_id='',reservation_id='r-y3f9kl6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1445145649',owner_user_name='tempest-TaggedBootDevicesTest_v242-1445145649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037b33a7d9740d5b868298dd0551edb',uuid=866f4abf-6566-4145-a780-953a4615659c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converting VIF {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:41:8e,bridge_name='br-int',has_traffic_filtering=True,id=e1d1d606-7370-46f1-8249-f5868d7b0af5,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d1d606-73') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:41:8e,bridge_name='br-int',has_traffic_filtering=True,id=e1d1d606-7370-46f1-8249-f5868d7b0af5,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d1d606-73') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1d1d606-73, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:29 user nova-compute[73029]: INFO os_vif [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:41:8e,bridge_name='br-int',has_traffic_filtering=True,id=e1d1d606-7370-46f1-8249-f5868d7b0af5,network=Network(158d5908-8a81-4c1b-8c2e-3f1b51118da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d1d606-73')
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCzqpcth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:38:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1889bc-af5c-4838-8b35-bcfd172eb01d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e44b39d-121d-4435-bb85-6fc46eb81c05]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141a6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e90c33-37ac-42e0-a911-8dc320000219]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23afcba-809f-4ba3-804e-d53290b63146]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0988804f-11a1-4224-9289-1e2693041c09]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[590bf9cf-d77d-4ca3-8b29-a50bc23551df]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8426b6-1efe-4f85-ac7e-0ec36f6d9f4c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627894.8117805, 37790055-25a9-4304-891e-17ccd8b0f46d => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:38:29 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] VM Stopped (Lifecycle Event)
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-ff8761db-163b-4ecb-9622-f82ed1b38bcd None None] [instance: 37790055-25a9-4304-891e-17ccd8b0f46d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d4ee1-a816-415b-85ff-fbe21e556c77]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c, portal: 172.16.0.220,3260]
Aug 10 00:38:29 user nova-compute[73029]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c, portal: 172.16.0.220,3260] successful.
Aug 10 00:38:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c76b36f-3752-4309-b922-f4eb0dd8417c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7e0f42-9df7-4e65-a428-94ca6a110df0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] <== disconnect_volume: return (314ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGvjoLda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:38:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e927bd0e-ffe7-426e-80ff-56bdd61df5b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1fcf94-35d2-45ce-8f05-61082fdd9442]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:29 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7528c0b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f7b6f-a841-4dd9-a29f-62ef00ea800f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[754e2675-bf21-4900-9f91-110322c76333]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:38:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a336a8-8c0b-441e-9a69-583d7618645f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[03890ee4-51cf-4249-bc6a-e075fd5201d7]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d85b5-c4e4-43c3-95e5-bd294cd3e81c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: WARNING nova.compute.manager [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-2fb1bff0-2a76-47ab-89c6-9463f7af33fb for instance with vm_state active and task_state deleting.
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-unplugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: WARNING nova.compute.manager [req-45977d25-2673-4ee1-ad5d-2bcead1e2573 req-f4cf0f1e-cd12-42dd-9939-c6ff4ac2075e service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd for instance with vm_state active and task_state deleting.
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a86c9d-0d99-4191-ba60-dbfb65d30b0e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966, portal: 172.16.0.220,3260]
Aug 10 00:38:30 user nova-compute[73029]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966, portal: 172.16.0.220,3260] successful.
Aug 10 00:38:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-ed246d9b-d91d-40b5-b717-709f504c368d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: WARNING nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-ed246d9b-d91d-40b5-b717-709f504c368d for instance with vm_state active and task_state deleting.
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-unplugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: WARNING nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-7828acf4-aa6f-4c50-9ef8-54badc35b15f for instance with vm_state active and task_state deleting.
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-unplugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: WARNING nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb for instance with vm_state active and task_state deleting.
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-unplugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: WARNING nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-7ee7c725-4d8e-4e06-a5a9-2871b750d499 for instance with vm_state active and task_state deleting.
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-unplugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ac9c4873-5000-46f5-a331-1674e7ffcfeb req-edd6f1bc-aec1-46ba-9814-738a25d13ba9 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-unplugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89636026-3f23-4019-a96b-d587a5949966 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd3f22-69fb-4d61-8944-6ecf704634dd]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] <== disconnect_volume: return (328ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcNEyJpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:38:30 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec60eb1-f0ff-42f1-a5bf-ec4f9e570cc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a22e1-5268-4ce9-8f0b-081620cade0f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:30 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:30 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:30 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:30 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 (non-flash)
Aug 10 00:38:30 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:38:30 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:38:30 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:38:30 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:38:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751419b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507'): ({'sdd'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Removing single pathed devices sdd {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[914cf2dd-066c-4b9d-9784-6d44679a0e1e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13345c0-f022-4f5e-8be0-a26462d0125b]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Flushing IO for device /dev/sdd {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[17323da3-9661-4ed0-9173-ea9458083184]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0343b-06ce-4173-858d-7bba7728f2ba]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f5d16d-7392-4e63-a52b-4548c3caecc1]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3734301-aa3f-4bbb-948e-05adb7177f26]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507, portal: 172.16.0.220,3260]
Aug 10 00:38:30 user nova-compute[73029]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507, portal: 172.16.0.220,3260] successful.
Aug 10 00:38:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135a31fe-a801-459a-a536-c5fe12070507 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcaafc2-1daf-4de4-a7be-0a988105575b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] <== disconnect_volume: return (327ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:38:30 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Deleting instance files /opt/stack/data/nova/instances/866f4abf-6566-4145-a780-953a4615659c_del
Aug 10 00:38:30 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Deletion of /opt/stack/data/nova/instances/866f4abf-6566-4145-a780-953a4615659c_del complete
Aug 10 00:38:30 user nova-compute[73029]: INFO nova.compute.manager [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Took 3.01 seconds to destroy the instance on the hypervisor.
Aug 10 00:38:30 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 866f4abf-6566-4145-a780-953a4615659c] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:38:30 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 866f4abf-6566-4145-a780-953a4615659c] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:38:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-513dc482-1eda-4f6a-beef-c161807e1f0b req-1ae41f55-3534-403c-9a6a-93c5d5b1151c service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-plugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-513dc482-1eda-4f6a-beef-c161807e1f0b req-1ae41f55-3534-403c-9a6a-93c5d5b1151c service nova] Acquiring lock "866f4abf-6566-4145-a780-953a4615659c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-513dc482-1eda-4f6a-beef-c161807e1f0b req-1ae41f55-3534-403c-9a6a-93c5d5b1151c service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-513dc482-1eda-4f6a-beef-c161807e1f0b req-1ae41f55-3534-403c-9a6a-93c5d5b1151c service nova] Lock "866f4abf-6566-4145-a780-953a4615659c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-513dc482-1eda-4f6a-beef-c161807e1f0b req-1ae41f55-3534-403c-9a6a-93c5d5b1151c service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] No waiting events found dispatching network-vif-plugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:32 user nova-compute[73029]: WARNING nova.compute.manager [req-513dc482-1eda-4f6a-beef-c161807e1f0b req-1ae41f55-3534-403c-9a6a-93c5d5b1151c service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received unexpected event network-vif-plugged-e1d1d606-7370-46f1-8249-f5868d7b0af5 for instance with vm_state active and task_state deleting.
Aug 10 00:38:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-d35442cf-6d5f-4623-943a-dfec0957492d req-264d4477-eda1-488a-9f5a-d8fa928382b2 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-deleted-7ee7c725-4d8e-4e06-a5a9-2871b750d499 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:32 user nova-compute[73029]: INFO nova.compute.manager [req-d35442cf-6d5f-4623-943a-dfec0957492d req-264d4477-eda1-488a-9f5a-d8fa928382b2 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Neutron deleted interface 7ee7c725-4d8e-4e06-a5a9-2871b750d499; detaching it from the instance and deleting it from the info cache
Aug 10 00:38:32 user nova-compute[73029]: DEBUG nova.network.neutron [req-d35442cf-6d5f-4623-943a-dfec0957492d req-264d4477-eda1-488a-9f5a-d8fa928382b2 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [{"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "address": "fa:16:3e:75:3d:f5", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014ba0f6-67", "ovs_interfaceid": "014ba0f6-67f6-4eba-ad88-5cc7e48a35fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-d35442cf-6d5f-4623-943a-dfec0957492d req-264d4477-eda1-488a-9f5a-d8fa928382b2 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Detach interface failed, port_id=7ee7c725-4d8e-4e06-a5a9-2871b750d499, reason: Instance 866f4abf-6566-4145-a780-953a4615659c could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:38:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-deleted-014ba0f6-67f6-4eba-ad88-5cc7e48a35fd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:34 user nova-compute[73029]: INFO nova.compute.manager [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Neutron deleted interface 014ba0f6-67f6-4eba-ad88-5cc7e48a35fd; detaching it from the instance and deleting it from the info cache
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [{"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "address": "fa:16:3e:08:87:97", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3b562-0c", "ovs_interfaceid": "8ea3b562-0cdb-49b5-bc3d-50d6d01198bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Detach interface failed, port_id=014ba0f6-67f6-4eba-ad88-5cc7e48a35fd, reason: Instance 866f4abf-6566-4145-a780-953a4615659c could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-deleted-8ea3b562-0cdb-49b5-bc3d-50d6d01198bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:34 user nova-compute[73029]: INFO nova.compute.manager [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Neutron deleted interface 8ea3b562-0cdb-49b5-bc3d-50d6d01198bb; detaching it from the instance and deleting it from the info cache
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [{"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "address": "fa:16:3e:db:41:8e", "network": {"id": "158d5908-8a81-4c1b-8c2e-3f1b51118da0", "bridge": "br-int", "label": "tempest-device-tagging-net2-2075999611", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d1d606-73", "ovs_interfaceid": "e1d1d606-7370-46f1-8249-f5868d7b0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Detach interface failed, port_id=8ea3b562-0cdb-49b5-bc3d-50d6d01198bb, reason: Instance 866f4abf-6566-4145-a780-953a4615659c could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-deleted-e1d1d606-7370-46f1-8249-f5868d7b0af5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:34 user nova-compute[73029]: INFO nova.compute.manager [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Neutron deleted interface e1d1d606-7370-46f1-8249-f5868d7b0af5; detaching it from the instance and deleting it from the info cache
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [{"id": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "address": "fa:16:3e:a7:e3:f1", "network": {"id": "5715dc1c-60f7-4b2b-90ea-9957073f1762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-911014801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fb1bff0-2a", "ovs_interfaceid": "2fb1bff0-2a76-47ab-89c6-9463f7af33fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed246d9b-d91d-40b5-b717-709f504c368d", "address": "fa:16:3e:4d:a8:43", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped246d9b-d9", "ovs_interfaceid": "ed246d9b-d91d-40b5-b717-709f504c368d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "address": "fa:16:3e:8e:88:e0", "network": {"id": "08c4af45-333a-41a0-a4c4-c1feef389679", "bridge": "br-int", "label": "tempest-device-tagging-net1-142062434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5bb0163154674b4eb8b6116b45917b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7828acf4-aa", "ovs_interfaceid": "7828acf4-aa6f-4c50-9ef8-54badc35b15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-57c08b2a-d2cf-4c85-b6b4-6ba52c182943 req-7e2529ee-13e6-4713-91af-7b4d13702e4b service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Detach interface failed, port_id=e1d1d606-7370-46f1-8249-f5868d7b0af5, reason: Instance 866f4abf-6566-4145-a780-953a4615659c could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:38:34 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 866f4abf-6566-4145-a780-953a4615659c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:34 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 866f4abf-6566-4145-a780-953a4615659c] Took 4.31 seconds to deallocate network for instance.
Aug 10 00:38:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-2bd7a782-e7f6-48c9-b325-b7bd5977d0e4 req-f85650da-5f07-43fe-b1a4-b1b800c35eb6 service nova] [instance: 866f4abf-6566-4145-a780-953a4615659c] Received event network-vif-deleted-2fb1bff0-2a76-47ab-89c6-9463f7af33fb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:37 user nova-compute[73029]: INFO nova.compute.manager [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] [instance: 866f4abf-6566-4145-a780-953a4615659c] Took 2.47 seconds to detach 3 volumes for instance.
Aug 10 00:38:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:37 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:38:37 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:38:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:37 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Deleted allocations for instance 866f4abf-6566-4145-a780-953a4615659c
Aug 10 00:38:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-66535462-af56-45ff-83e8-6f95326b1513 tempest-TaggedBootDevicesTest_v242-1445145649 tempest-TaggedBootDevicesTest_v242-1445145649-project-member] Lock "866f4abf-6566-4145-a780-953a4615659c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.304s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627909.1937923, 866f4abf-6566-4145-a780-953a4615659c => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:38:44 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 866f4abf-6566-4145-a780-953a4615659c] VM Stopped (Lifecycle Event)
Aug 10 00:38:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5257fb0f-191a-4cd9-a3e0-cea545e1faa5 None None] [instance: 866f4abf-6566-4145-a780-953a4615659c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "2256b7fd-3705-438c-86d0-06dd355b4347" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "2256b7fd-3705-438c-86d0-06dd355b4347" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:38:44 user nova-compute[73029]: INFO nova.compute.claims [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Claim successful on node user
Aug 10 00:38:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:38:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.policy [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f52da2ce49444c19eac225f85e7a157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cacd78e5db48399ddb0b666498b7af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:38:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Creating image(s)
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "/opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "/opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "/opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.184s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk 1073741824" returned: 0 in 0.057s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Successfully created port: ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Cannot resize image /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lazy-loading 'migration_context' on Instance uuid 2256b7fd-3705-438c-86d0-06dd355b4347 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Ensure instance console log exists: /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Successfully updated port: ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "refresh_cache-2256b7fd-3705-438c-86d0-06dd355b4347" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquired lock "refresh_cache-2256b7fd-3705-438c-86d0-06dd355b4347" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-cdcade6f-b793-486e-84db-ce1d9801aec5 req-2a1c5646-4bcb-421e-aabe-cb76fa47a8c6 service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received event network-changed-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-cdcade6f-b793-486e-84db-ce1d9801aec5 req-2a1c5646-4bcb-421e-aabe-cb76fa47a8c6 service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Refreshing instance network info cache due to event network-changed-ce2615d8-c701-494d-9daf-40aa72e7fb81. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cdcade6f-b793-486e-84db-ce1d9801aec5 req-2a1c5646-4bcb-421e-aabe-cb76fa47a8c6 service nova] Acquiring lock "refresh_cache-2256b7fd-3705-438c-86d0-06dd355b4347" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Updating instance_info_cache with network_info: [{"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Releasing lock "refresh_cache-2256b7fd-3705-438c-86d0-06dd355b4347" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Instance network_info: |[{"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cdcade6f-b793-486e-84db-ce1d9801aec5 req-2a1c5646-4bcb-421e-aabe-cb76fa47a8c6 service nova] Acquired lock "refresh_cache-2256b7fd-3705-438c-86d0-06dd355b4347" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.network.neutron [req-cdcade6f-b793-486e-84db-ce1d9801aec5 req-2a1c5646-4bcb-421e-aabe-cb76fa47a8c6 service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Refreshing network info cache for port ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Start _get_guest_xml network_info=[{"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:38:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:38:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1685367590',display_name='tempest-VolumesAdminNegativeTest-server-1685367590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1685367590',id=14,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65cacd78e5db48399ddb0b666498b7af',ramdisk_id='',reservation_id='r-vfts5khq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-592274289',owner_user_name='tempest-VolumesAdminNegativeTest-592274289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:38:45Z,user_data=None,user_id='2f52da2ce49444c19eac225f85e7a157',uuid=2256b7fd-3705-438c-86d0-06dd355b4347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converting VIF {"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:e5:df,bridge_name='br-int',has_traffic_filtering=True,id=ce2615d8-c701-494d-9daf-40aa72e7fb81,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2615d8-c7') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lazy-loading 'pci_devices' on Instance uuid 2256b7fd-3705-438c-86d0-06dd355b4347 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:38:46 user nova-compute[73029]:   <uuid>2256b7fd-3705-438c-86d0-06dd355b4347</uuid>
Aug 10 00:38:46 user nova-compute[73029]:   <name>instance-0000000e</name>
Aug 10 00:38:46 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:38:46 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:38:46 user nova-compute[73029]:   <metadata>
Aug 10 00:38:46 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:38:46 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:38:46 user nova-compute[73029]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1685367590</nova:name>
Aug 10 00:38:46 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:38:46</nova:creationTime>
Aug 10 00:38:46 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:38:46 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:38:46 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:38:46 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:38:46 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:38:46 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:38:46 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:38:46 user nova-compute[73029]:       <nova:owner>
Aug 10 00:38:46 user nova-compute[73029]:         <nova:user uuid="2f52da2ce49444c19eac225f85e7a157">tempest-VolumesAdminNegativeTest-592274289-project-member</nova:user>
Aug 10 00:38:46 user nova-compute[73029]:         <nova:project uuid="65cacd78e5db48399ddb0b666498b7af">tempest-VolumesAdminNegativeTest-592274289</nova:project>
Aug 10 00:38:46 user nova-compute[73029]:       </nova:owner>
Aug 10 00:38:46 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:38:46 user nova-compute[73029]:       <nova:ports>
Aug 10 00:38:46 user nova-compute[73029]:         <nova:port uuid="ce2615d8-c701-494d-9daf-40aa72e7fb81">
Aug 10 00:38:46 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 10 00:38:46 user nova-compute[73029]:         </nova:port>
Aug 10 00:38:46 user nova-compute[73029]:       </nova:ports>
Aug 10 00:38:46 user nova-compute[73029]:     </nova:instance>
Aug 10 00:38:46 user nova-compute[73029]:   </metadata>
Aug 10 00:38:46 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:38:46 user nova-compute[73029]:     <system>
Aug 10 00:38:46 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:38:46 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:38:46 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:38:46 user nova-compute[73029]:       <entry name="serial">2256b7fd-3705-438c-86d0-06dd355b4347</entry>
Aug 10 00:38:46 user nova-compute[73029]:       <entry name="uuid">2256b7fd-3705-438c-86d0-06dd355b4347</entry>
Aug 10 00:38:46 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:38:46 user nova-compute[73029]:     </system>
Aug 10 00:38:46 user nova-compute[73029]:   </sysinfo>
Aug 10 00:38:46 user nova-compute[73029]:   <os>
Aug 10 00:38:46 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:38:46 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:38:46 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:38:46 user nova-compute[73029]:   </os>
Aug 10 00:38:46 user nova-compute[73029]:   <features>
Aug 10 00:38:46 user nova-compute[73029]:     <acpi/>
Aug 10 00:38:46 user nova-compute[73029]:     <apic/>
Aug 10 00:38:46 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:38:46 user nova-compute[73029]:   </features>
Aug 10 00:38:46 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:38:46 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:38:46 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:38:46 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:38:46 user nova-compute[73029]:   </clock>
Aug 10 00:38:46 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:38:46 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:38:46 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:38:46 user nova-compute[73029]:   </cpu>
Aug 10 00:38:46 user nova-compute[73029]:   <devices>
Aug 10 00:38:46 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:38:46 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:38:46 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk"/>
Aug 10 00:38:46 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:38:46 user nova-compute[73029]:     </disk>
Aug 10 00:38:46 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:38:46 user nova-compute[73029]:       <mac address="fa:16:3e:da:e5:df"/>
Aug 10 00:38:46 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:38:46 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:38:46 user nova-compute[73029]:       <target dev="tapce2615d8-c7"/>
Aug 10 00:38:46 user nova-compute[73029]:     </interface>
Aug 10 00:38:46 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:38:46 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/console.log" append="off"/>
Aug 10 00:38:46 user nova-compute[73029]:     </serial>
Aug 10 00:38:46 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:38:46 user nova-compute[73029]:     <video>
Aug 10 00:38:46 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:38:46 user nova-compute[73029]:     </video>
Aug 10 00:38:46 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:38:46 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:38:46 user nova-compute[73029]:     </rng>
Aug 10 00:38:46 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:38:46 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:38:46 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:38:46 user nova-compute[73029]:     </memballoon>
Aug 10 00:38:46 user nova-compute[73029]:   </devices>
Aug 10 00:38:46 user nova-compute[73029]: </domain>
Aug 10 00:38:46 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1685367590',display_name='tempest-VolumesAdminNegativeTest-server-1685367590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1685367590',id=14,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65cacd78e5db48399ddb0b666498b7af',ramdisk_id='',reservation_id='r-vfts5khq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-592274289',owner_user_name='tempest-VolumesAdminNegativeTest-592274289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:38:45Z,user_data=None,user_id='2f52da2ce49444c19eac225f85e7a157',uuid=2256b7fd-3705-438c-86d0-06dd355b4347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converting VIF {"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:e5:df,bridge_name='br-int',has_traffic_filtering=True,id=ce2615d8-c701-494d-9daf-40aa72e7fb81,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2615d8-c7') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG os_vif [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e5:df,bridge_name='br-int',has_traffic_filtering=True,id=ce2615d8-c701-494d-9daf-40aa72e7fb81,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2615d8-c7') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce2615d8-c7, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce2615d8-c7, col_values=(('external_ids', {'iface-id': 'ce2615d8-c701-494d-9daf-40aa72e7fb81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:e5:df', 'vm-uuid': '2256b7fd-3705-438c-86d0-06dd355b4347'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:46 user nova-compute[73029]: INFO os_vif [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e5:df,bridge_name='br-int',has_traffic_filtering=True,id=ce2615d8-c701-494d-9daf-40aa72e7fb81,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2615d8-c7')
Aug 10 00:38:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] No VIF found with MAC fa:16:3e:da:e5:df, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG nova.network.neutron [req-cdcade6f-b793-486e-84db-ce1d9801aec5 req-2a1c5646-4bcb-421e-aabe-cb76fa47a8c6 service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Updated VIF entry in instance network info cache for port ce2615d8-c701-494d-9daf-40aa72e7fb81. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG nova.network.neutron [req-cdcade6f-b793-486e-84db-ce1d9801aec5 req-2a1c5646-4bcb-421e-aabe-cb76fa47a8c6 service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Updating instance_info_cache with network_info: [{"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cdcade6f-b793-486e-84db-ce1d9801aec5 req-2a1c5646-4bcb-421e-aabe-cb76fa47a8c6 service nova] Releasing lock "refresh_cache-2256b7fd-3705-438c-86d0-06dd355b4347" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:47 user nova-compute[73029]: INFO nova.compute.manager [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Terminating instance
Aug 10 00:38:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-e933ff32-76c4-4323-9e28-40ad39e7af3c req-3763ed56-d5f7-4e2c-b963-416214e7a47d service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received event network-vif-unplugged-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e933ff32-76c4-4323-9e28-40ad39e7af3c req-3763ed56-d5f7-4e2c-b963-416214e7a47d service nova] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e933ff32-76c4-4323-9e28-40ad39e7af3c req-3763ed56-d5f7-4e2c-b963-416214e7a47d service nova] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e933ff32-76c4-4323-9e28-40ad39e7af3c req-3763ed56-d5f7-4e2c-b963-416214e7a47d service nova] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-e933ff32-76c4-4323-9e28-40ad39e7af3c req-3763ed56-d5f7-4e2c-b963-416214e7a47d service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] No waiting events found dispatching network-vif-unplugged-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-e933ff32-76c4-4323-9e28-40ad39e7af3c req-3763ed56-d5f7-4e2c-b963-416214e7a47d service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received event network-vif-unplugged-fec11eed-17da-425c-89be-003dfd7f60c6 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Instance destroyed successfully.
Aug 10 00:38:48 user nova-compute[73029]: DEBUG nova.objects.instance [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lazy-loading 'resources' on Instance uuid 77e0dc6b-541f-4032-9f93-f0cc395b0a22 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-282335105',display_name='tempest-VolumesAssistedSnapshotsTest-server-282335105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-282335105',id=6,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPveiMJZkK2uODP1nxNdjTxYfCOo5NOazSmIz56i5X28loUOAup74lwjwRXBbn+OAE/kggMC12unw1EhhPut3gzdjnGbDvHB/OCqeUWDIj105PJfUnxHRGNPLTD7ILhVQ==',key_name='tempest-keypair-1623386701',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:35:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ba8a47ca61640859b942d60732adfb3',ramdisk_id='',reservation_id='r-hpamexyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-592322439',owner_user_name='tempest-VolumesAssistedSnapshotsTest-592322439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf978307cc87467ca8bcbf895a236acf',uuid=77e0dc6b-541f-4032-9f93-f0cc395b0a22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Converting VIF {"id": "fec11eed-17da-425c-89be-003dfd7f60c6", "address": "fa:16:3e:a9:15:c8", "network": {"id": "c83f9c82-c79c-4752-af66-70866e7e82b2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-746402212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba8a47ca61640859b942d60732adfb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec11eed-17", "ovs_interfaceid": "fec11eed-17da-425c-89be-003dfd7f60c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:15:c8,bridge_name='br-int',has_traffic_filtering=True,id=fec11eed-17da-425c-89be-003dfd7f60c6,network=Network(c83f9c82-c79c-4752-af66-70866e7e82b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec11eed-17') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG os_vif [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:15:c8,bridge_name='br-int',has_traffic_filtering=True,id=fec11eed-17da-425c-89be-003dfd7f60c6,network=Network(c83f9c82-c79c-4752-af66-70866e7e82b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec11eed-17') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfec11eed-17, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:48 user nova-compute[73029]: INFO os_vif [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:15:c8,bridge_name='br-int',has_traffic_filtering=True,id=fec11eed-17da-425c-89be-003dfd7f60c6,network=Network(c83f9c82-c79c-4752-af66-70866e7e82b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec11eed-17')
Aug 10 00:38:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Deleting instance files /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22_del
Aug 10 00:38:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Deletion of /opt/stack/data/nova/instances/77e0dc6b-541f-4032-9f93-f0cc395b0a22_del complete
Aug 10 00:38:49 user nova-compute[73029]: INFO nova.compute.manager [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 10 00:38:49 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:38:49 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:38:49 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:38:49 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-96be1bbd-cae3-4400-a163-f05d49e910df req-07c62be7-2309-49c4-90b0-036cfaf728d7 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received event network-vif-deleted-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:49 user nova-compute[73029]: INFO nova.compute.manager [req-96be1bbd-cae3-4400-a163-f05d49e910df req-07c62be7-2309-49c4-90b0-036cfaf728d7 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Neutron deleted interface fec11eed-17da-425c-89be-003dfd7f60c6; detaching it from the instance and deleting it from the info cache
Aug 10 00:38:49 user nova-compute[73029]: DEBUG nova.network.neutron [req-96be1bbd-cae3-4400-a163-f05d49e910df req-07c62be7-2309-49c4-90b0-036cfaf728d7 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:38:49 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Took 0.92 seconds to deallocate network for instance.
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-96be1bbd-cae3-4400-a163-f05d49e910df req-07c62be7-2309-49c4-90b0-036cfaf728d7 service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Detach interface failed, port_id=fec11eed-17da-425c-89be-003dfd7f60c6, reason: Instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received event network-vif-plugged-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] Acquiring lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] No waiting events found dispatching network-vif-plugged-fec11eed-17da-425c-89be-003dfd7f60c6 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:50 user nova-compute[73029]: WARNING nova.compute.manager [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Received unexpected event network-vif-plugged-fec11eed-17da-425c-89be-003dfd7f60c6 for instance with vm_state deleted and task_state None.
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received event network-vif-plugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] Acquiring lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] No waiting events found dispatching network-vif-plugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:50 user nova-compute[73029]: WARNING nova.compute.manager [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received unexpected event network-vif-plugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 for instance with vm_state building and task_state spawning.
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received event network-vif-plugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] Acquiring lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] No waiting events found dispatching network-vif-plugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:50 user nova-compute[73029]: WARNING nova.compute.manager [req-11bcfacf-6fa0-4ed4-93ec-be950f6a7acf req-5aa8ceae-7b13-417e-8361-82f699b50bdb service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received unexpected event network-vif-plugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 for instance with vm_state building and task_state spawning.
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:50 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Deleted allocations for instance 77e0dc6b-541f-4032-9f93-f0cc395b0a22
Aug 10 00:38:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-eef0f66c-140b-49f3-bd80-90df2eed0c14 tempest-VolumesAssistedSnapshotsTest-592322439 tempest-VolumesAssistedSnapshotsTest-592322439-project-member] Lock "77e0dc6b-541f-4032-9f93-f0cc395b0a22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.688s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627930.8080878, 2256b7fd-3705-438c-86d0-06dd355b4347 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:38:50 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] VM Resumed (Lifecycle Event)
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:38:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Instance spawned successfully.
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:38:50 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627930.8094223, 2256b7fd-3705-438c-86d0-06dd355b4347 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:38:50 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] VM Started (Lifecycle Event)
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:38:50 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:38:50 user nova-compute[73029]: INFO nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 10 00:38:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:38:51 user nova-compute[73029]: INFO nova.compute.manager [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Took 6.52 seconds to build instance.
Aug 10 00:38:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c8de944-7f88-4370-ac77-b74849cb7b1e tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "2256b7fd-3705-438c-86d0-06dd355b4347" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.637s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:58 user nova-compute[73029]: INFO nova.compute.manager [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Terminating instance
Aug 10 00:38:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-d64d2dd5-6219-4ebf-aea1-f7833ef17228 req-273fb837-5af4-42b9-88b9-36b39f28e36c service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-unplugged-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d64d2dd5-6219-4ebf-aea1-f7833ef17228 req-273fb837-5af4-42b9-88b9-36b39f28e36c service nova] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d64d2dd5-6219-4ebf-aea1-f7833ef17228 req-273fb837-5af4-42b9-88b9-36b39f28e36c service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d64d2dd5-6219-4ebf-aea1-f7833ef17228 req-273fb837-5af4-42b9-88b9-36b39f28e36c service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-d64d2dd5-6219-4ebf-aea1-f7833ef17228 req-273fb837-5af4-42b9-88b9-36b39f28e36c service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] No waiting events found dispatching network-vif-unplugged-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-d64d2dd5-6219-4ebf-aea1-f7833ef17228 req-273fb837-5af4-42b9-88b9-36b39f28e36c service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-unplugged-05000558-c8bc-4dfc-b4de-5debccaa24fe for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:38:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Instance destroyed successfully.
Aug 10 00:38:59 user nova-compute[73029]: DEBUG nova.objects.instance [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lazy-loading 'resources' on Instance uuid 118963ea-d3cf-4c10-945f-4718a02412c1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-352229283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-352229283',id=7,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSQZlX8tI3HUwW5UVA7H4kJ0KQcIp1DOQA6cc1Hg9qny8FShjYMyHMG2A1DuZmIP9gEfAxzEQzKQ18gbQeFKmztjw82TU4PUw9XXXpr4uKfgwEa89ahnNeAGiXSbMh7qA==',key_name='tempest-keypair-1362690543',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db8942a3a3544a2dac7a3a89a864dd0b',ramdisk_id='',reservation_id='r-yhqgxnwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1142167359',owner_user_name='tempest-TaggedAttachmentsTest-1142167359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b480acf3baa421ba056043c717e942f',uuid=118963ea-d3cf-4c10-945f-4718a02412c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converting VIF {"id": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "address": "fa:16:3e:d0:f6:08", "network": {"id": "f6830c69-fe03-4f47-bf3a-397be8001842", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1544088193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db8942a3a3544a2dac7a3a89a864dd0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05000558-c8", "ovs_interfaceid": "05000558-c8bc-4dfc-b4de-5debccaa24fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=05000558-c8bc-4dfc-b4de-5debccaa24fe,network=Network(f6830c69-fe03-4f47-bf3a-397be8001842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05000558-c8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG os_vif [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=05000558-c8bc-4dfc-b4de-5debccaa24fe,network=Network(f6830c69-fe03-4f47-bf3a-397be8001842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05000558-c8') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05000558-c8, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:38:59 user nova-compute[73029]: INFO os_vif [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:f6:08,bridge_name='br-int',has_traffic_filtering=True,id=05000558-c8bc-4dfc-b4de-5debccaa24fe,network=Network(f6830c69-fe03-4f47-bf3a-397be8001842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05000558-c8')
Aug 10 00:38:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Deleting instance files /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1_del
Aug 10 00:38:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Deletion of /opt/stack/data/nova/instances/118963ea-d3cf-4c10-945f-4718a02412c1_del complete
Aug 10 00:38:59 user nova-compute[73029]: INFO nova.compute.manager [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 10 00:38:59 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:38:59 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:39:00 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:00 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Took 1.20 seconds to deallocate network for instance.
Aug 10 00:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-f0d969c2-e646-4146-83fd-f6498e1fea0a req-01080a90-dcb6-4b0f-a496-03f28fb9f218 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-plugged-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f0d969c2-e646-4146-83fd-f6498e1fea0a req-01080a90-dcb6-4b0f-a496-03f28fb9f218 service nova] Acquiring lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f0d969c2-e646-4146-83fd-f6498e1fea0a req-01080a90-dcb6-4b0f-a496-03f28fb9f218 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f0d969c2-e646-4146-83fd-f6498e1fea0a req-01080a90-dcb6-4b0f-a496-03f28fb9f218 service nova] Lock "118963ea-d3cf-4c10-945f-4718a02412c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-f0d969c2-e646-4146-83fd-f6498e1fea0a req-01080a90-dcb6-4b0f-a496-03f28fb9f218 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] No waiting events found dispatching network-vif-plugged-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:01 user nova-compute[73029]: WARNING nova.compute.manager [req-f0d969c2-e646-4146-83fd-f6498e1fea0a req-01080a90-dcb6-4b0f-a496-03f28fb9f218 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received unexpected event network-vif-plugged-05000558-c8bc-4dfc-b4de-5debccaa24fe for instance with vm_state deleted and task_state None.
Aug 10 00:39:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-f0d969c2-e646-4146-83fd-f6498e1fea0a req-01080a90-dcb6-4b0f-a496-03f28fb9f218 service nova] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Received event network-vif-deleted-05000558-c8bc-4dfc-b4de-5debccaa24fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:01 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:39:01 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:39:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:01 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Deleted allocations for instance 118963ea-d3cf-4c10-945f-4718a02412c1
Aug 10 00:39:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-02d7f901-36df-4d90-a5d4-3c25515dcf9f tempest-TaggedAttachmentsTest-1142167359 tempest-TaggedAttachmentsTest-1142167359-project-member] Lock "118963ea-d3cf-4c10-945f-4718a02412c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.560s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:03 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627928.9548943, 77e0dc6b-541f-4032-9f93-f0cc395b0a22 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:03 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] VM Stopped (Lifecycle Event)
Aug 10 00:39:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-42a71e88-552b-45d4-a8a7-7fde0714ddf4 None None] [instance: 77e0dc6b-541f-4032-9f93-f0cc395b0a22] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'flavor' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:10 user nova-compute[73029]: INFO nova.compute.manager [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Attaching volume 781b69f3-9c5f-461e-9a85-7812a66ef39c to /dev/vdb
Aug 10 00:39:10 user nova-compute[73029]: DEBUG os_brick.utils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed86652b-6c1c-4ffb-8fb4-606f2b1eb4da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[745a1b78-9cca-43c4-b556-2567be120357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[06157577-ac58-4051-98a5-1296a736f520]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fd7bec-ecc3-42f7-8647-af6da8c2eabb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:39:11 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:39:11 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73eab1f-299e-4268-8489-882b5ff85da3]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG os_brick.utils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating existing volume attachment record: 4791d83e-086e-4d4f-9bb9-a2105ff5dd03 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:39:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'flavor' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:13 user nova-compute[73029]: INFO nova.compute.manager [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Attaching volume 85bd054b-8da1-42f8-b7b5-404ba7974bc5 to /dev/vdb
Aug 10 00:39:13 user nova-compute[73029]: DEBUG os_brick.utils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d15a83-4f72-4251-9e24-b72b0d8193c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1e48fa-eae3-4d36-b89e-3231111b63dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[02864d13-1c61-43f3-a35c-6b861bfea08a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cfe882-e7d1-447b-bb3d-f16f917abd4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:39:13 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e764a6-b9ff-4bd7-b468-41e6cb6d3276]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG os_brick.utils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating existing volume attachment record: e93abd5e-3f21-45cf-b96b-53c5748b99c9 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:39:13 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:39:14 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627939.5307958, 118963ea-d3cf-4c10-945f-4718a02412c1 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:14 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] VM Stopped (Lifecycle Event)
Aug 10 00:39:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-773a84a6-78cb-4118-9d00-b09835ec7a61 None None] [instance: 118963ea-d3cf-4c10-945f-4718a02412c1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:14 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Updating instance_info_cache with network_info: [{"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-aa5be433-9c8a-4e52-b61d-15a84f188cc3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:39:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:39:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:19 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:39:19 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7429MB free_disk=25.458538055419922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cc846d6c-027a-4a9a-819f-27919f3d2b25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance dc191a1a-b684-4b2a-8cee-0572a6396b0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f1561416-585d-4d7d-a1d7-86a64cf00630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 2256b7fd-3705-438c-86d0-06dd355b4347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:39:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-17231494-28c7-47ca-807a-afd6e363b79d req-68ac0077-33f9-4348-9d67-1a660cf6e91f service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-changed-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-17231494-28c7-47ca-807a-afd6e363b79d req-68ac0077-33f9-4348-9d67-1a660cf6e91f service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing instance network info cache due to event network-changed-8ac791ec-7eb0-4442-b465-48b912df2761. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-17231494-28c7-47ca-807a-afd6e363b79d req-68ac0077-33f9-4348-9d67-1a660cf6e91f service nova] Acquiring lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-17231494-28c7-47ca-807a-afd6e363b79d req-68ac0077-33f9-4348-9d67-1a660cf6e91f service nova] Acquired lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-17231494-28c7-47ca-807a-afd6e363b79d req-68ac0077-33f9-4348-9d67-1a660cf6e91f service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Refreshing network info cache for port 8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXgpkLDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:39:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:39:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:21 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64bacbc-ac51-494f-b2fb-9554e2991e25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:39:21 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a35b43-ec96-48b4-bcd4-544b2ce8e49e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c] added
Aug 10 00:39:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad10cff-1512-4827-87b0-a9ae2ebb7226]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a80af1-e0af-4faf-a040-b6862736004f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXgpkLDz {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXgpkLDz" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dd5961-502c-4fa1-9ea5-02bdc700ea56]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qXgpkLDz'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[608d07c0-4a12-47bf-bba6-9f73aa8d102a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c89c6a-4ef4-4949-ac5d-54b9979d3ee8]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1b0a5c-4c05-4759-83ed-65f200ef42a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c, portal: 172.16.0.220,3260]
Aug 10 00:39:22 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c, portal: 172.16.0.220,3260] successful.
Aug 10 00:39:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c5be45-abd0-4a26-a821-d9670829973e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3816060a-b2ba-4813-b445-e94c3641a0c7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:22 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e369c57-32cf-4fa4-9548-e2c92d722d2b]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-17231494-28c7-47ca-807a-afd6e363b79d req-68ac0077-33f9-4348-9d67-1a660cf6e91f service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updated VIF entry in instance network info cache for port 8ac791ec-7eb0-4442-b465-48b912df2761. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-17231494-28c7-47ca-807a-afd6e363b79d req-68ac0077-33f9-4348-9d67-1a660cf6e91f service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [{"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-17231494-28c7-47ca-807a-afd6e363b79d req-68ac0077-33f9-4348-9d67-1a660cf6e91f service nova] Releasing lock "refresh_cache-cc846d6c-027a-4a9a-819f-27919f3d2b25" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXgpkLDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23337366562383633', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337366562383633', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG nova.objects.instance [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'flavor' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:39:23 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:39:23 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:39:23 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:39:23 user nova-compute[73029]:   <serial>781b69f3-9c5f-461e-9a85-7812a66ef39c</serial>
Aug 10 00:39:23 user nova-compute[73029]: </disk>
Aug 10 00:39:23 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] No VIF found with MAC fa:16:3e:bb:10:a5, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:39:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-60634ff9-562f-46bd-8315-42b8ffc2c96a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.034s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXucSwLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:24 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:24 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:24 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[901579d8-30cb-41ed-ad07-f3c024199a57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:39:24 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7027b75b-d7d9-4b25-83df-74ed3697bcb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5] added
Aug 10 00:39:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d1cb25-f09e-43aa-b80a-060f222c3d15]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d79549-4c79-4100-a309-7a649b8e4adb]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXucSwLQ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXucSwLQ" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7dde0b-dae9-4439-ac80-01b3ea60590b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qXucSwLQ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4171794c-8bcd-4437-8d45-f2acdcfd2e41]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a4c6a-ca86-47c2-b52a-591b69abf894]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b736df5a-0d81-4f3e-9ae8-ab451f325e3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260]
Aug 10 00:39:24 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260] successful.
Aug 10 00:39:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6661a9ef-1a2d-47e4-9c3f-9f102260fb73]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db9ec95-c8e3-4ed4-98ac-956cae8be2a4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:24 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7824a47e-37b9-435e-9ddc-bcdd0a718942]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXucSwLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:24 user nova-compute[73029]: INFO nova.compute.manager [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Terminating instance
Aug 10 00:39:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:24 user nova-compute[73029]: INFO nova.compute.manager [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Rescuing
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquired lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-0b2c16c7-814a-49e0-bcf4-0c4f246eecc6 req-1ddedb4e-d779-4572-aee7-84f92149af50 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0b2c16c7-814a-49e0-bcf4-0c4f246eecc6 req-1ddedb4e-d779-4572-aee7-84f92149af50 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0b2c16c7-814a-49e0-bcf4-0c4f246eecc6 req-1ddedb4e-d779-4572-aee7-84f92149af50 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0b2c16c7-814a-49e0-bcf4-0c4f246eecc6 req-1ddedb4e-d779-4572-aee7-84f92149af50 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-0b2c16c7-814a-49e0-bcf4-0c4f246eecc6 req-1ddedb4e-d779-4572-aee7-84f92149af50 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-unplugged-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-0b2c16c7-814a-49e0-bcf4-0c4f246eecc6 req-1ddedb4e-d779-4572-aee7-84f92149af50 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-8ac791ec-7eb0-4442-b465-48b912df2761 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23137633435616336', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137633435616336', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'flavor' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:39:25 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:39:25 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 00:39:25 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:39:25 user nova-compute[73029]:   <serial>85bd054b-8da1-42f8-b7b5-404ba7974bc5</serial>
Aug 10 00:39:25 user nova-compute[73029]: </disk>
Aug 10 00:39:25 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-2ce2f57a-ad65-4b29-a37d-116676c74e77 req-85e08194-afe9-4e3a-b5df-ae5be5541f12 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2ce2f57a-ad65-4b29-a37d-116676c74e77 req-85e08194-afe9-4e3a-b5df-ae5be5541f12 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2ce2f57a-ad65-4b29-a37d-116676c74e77 req-85e08194-afe9-4e3a-b5df-ae5be5541f12 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2ce2f57a-ad65-4b29-a37d-116676c74e77 req-85e08194-afe9-4e3a-b5df-ae5be5541f12 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-2ce2f57a-ad65-4b29-a37d-116676c74e77 req-85e08194-afe9-4e3a-b5df-ae5be5541f12 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-unplugged-4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-2ce2f57a-ad65-4b29-a37d-116676c74e77 req-85e08194-afe9-4e3a-b5df-ae5be5541f12 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-4ee226a2-f9d2-4055-8745-13664dffb75b for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.network.neutron [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating instance_info_cache with network_info: [{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Releasing lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:39:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Instance destroyed successfully.
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lazy-loading 'resources' on Instance uuid cc846d6c-027a-4a9a-819f-27919f3d2b25 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "8ac791ec-7eb0-4442-b465-48b912df2761", "address": "fa:16:3e:7b:33:d0", "network": {"id": "d0c95518-35b2-47e1-af90-e735f38ac458", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-75694205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac791ec-7e", "ovs_interfaceid": "8ac791ec-7eb0-4442-b465-48b912df2761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:33:d0,bridge_name='br-int',has_traffic_filtering=True,id=8ac791ec-7eb0-4442-b465-48b912df2761,network=Network(d0c95518-35b2-47e1-af90-e735f38ac458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac791ec-7e') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:33:d0,bridge_name='br-int',has_traffic_filtering=True,id=8ac791ec-7eb0-4442-b465-48b912df2761,network=Network(d0c95518-35b2-47e1-af90-e735f38ac458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac791ec-7e') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ac791ec-7e, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No VIF found with MAC fa:16:3e:16:10:6b, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: INFO os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:33:d0,bridge_name='br-int',has_traffic_filtering=True,id=8ac791ec-7eb0-4442-b465-48b912df2761,network=Network(d0c95518-35b2-47e1-af90-e735f38ac458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac791ec-7e')
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:76:4e,bridge_name='br-int',has_traffic_filtering=True,id=4ee226a2-f9d2-4055-8745-13664dffb75b,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ee226a2-f9') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:76:4e,bridge_name='br-int',has_traffic_filtering=True,id=4ee226a2-f9d2-4055-8745-13664dffb75b,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ee226a2-f9') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ee226a2-f9, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c8c67aaf-c862-4392-87d1-42bf58687daf tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.577s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: INFO os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:76:4e,bridge_name='br-int',has_traffic_filtering=True,id=4ee226a2-f9d2-4055-8745-13664dffb75b,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ee226a2-f9')
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:46:e7,bridge_name='br-int',has_traffic_filtering=True,id=cca97791-958d-430b-9b6e-6125b2d4d28e,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcca97791-95') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:46:e7,bridge_name='br-int',has_traffic_filtering=True,id=cca97791-958d-430b-9b6e-6125b2d4d28e,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcca97791-95') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcca97791-95, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: INFO os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:46:e7,bridge_name='br-int',has_traffic_filtering=True,id=cca97791-958d-430b-9b6e-6125b2d4d28e,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcca97791-95')
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=13993caf-e057-46cb-b468-16a2ac962265,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13993caf-e0') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=13993caf-e057-46cb-b468-16a2ac962265,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13993caf-e0') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13993caf-e0, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: INFO os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=13993caf-e057-46cb-b468-16a2ac962265,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13993caf-e0')
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:66,bridge_name='br-int',has_traffic_filtering=True,id=c4677a60-3c27-4eb0-afa2-9f3d9be13600,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4677a60-3c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:66,bridge_name='br-int',has_traffic_filtering=True,id=c4677a60-3c27-4eb0-afa2-9f3d9be13600,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4677a60-3c') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4677a60-3c, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: INFO os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:66,bridge_name='br-int',has_traffic_filtering=True,id=c4677a60-3c27-4eb0-afa2-9f3d9be13600,network=Network(99b45c17-aa00-4894-8466-93dedbfcdf75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4677a60-3c')
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=5cdd5d6a-c5a5-491f-8dc9-f0494a413de5,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdd5d6a-c5') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=5cdd5d6a-c5a5-491f-8dc9-f0494a413de5,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdd5d6a-c5') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cdd5d6a-c5, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Instance destroyed successfully.
Aug 10 00:39:27 user nova-compute[73029]: INFO os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=5cdd5d6a-c5a5-491f-8dc9-f0494a413de5,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cdd5d6a-c5')
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-10T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-988791272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-988791272',id=11,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW/v4BJd1z54xNJhYwfr7JMt+PVnEwbEegCJpIRdP3auWRExcyLjMVPZtdUkyzA8+BXQIyAlmnmQrGwF/7oFjYcEZpY6ng3vJI+FlvKDoLSiH10xfYprVegos1jvxHU/w==',key_name='tempest-keypair-538049365',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2f4204aa7a2494c9233a97287b929da',ramdisk_id='',reservation_id='r-8nfmgzka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-417793474',owner_user_name='tempest-TaggedBootDevicesTest-417793474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53bd067c0fbe49c5a418cf218e0f685b',uuid=cc846d6c-027a-4a9a-819f-27919f3d2b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converting VIF {"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:07:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee0d0456-d275-4932-a6ff-3de6fb281337,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0d0456-d2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:07:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee0d0456-d275-4932-a6ff-3de6fb281337,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0d0456-d2') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee0d0456-d2, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Attempting a stable device rescue
Aug 10 00:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:27 user nova-compute[73029]: INFO os_vif [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:07:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee0d0456-d275-4932-a6ff-3de6fb281337,network=Network(e79cc939-ac35-4337-ada6-e3adbda5c9ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0d0456-d2')
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWLBxCbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:27 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73029) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[214764ed-0abe-4826-9cdc-4ea72ea9a63a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Instance directory exists: not creating {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 10 00:39:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Creating image(s)
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "828496fb177a80cf95b71a60d6ad443c1ff9d015" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "828496fb177a80cf95b71a60d6ad443c1ff9d015" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4d2085-9986-49b2-b441-664f837b0180]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:27 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7514269480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b'): ({'sde'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Removing single pathed devices sde {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3fe746-1e0e-4a10-b5f2-c1f5aeeee4e2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd1e49-bc3f-44b2-ba29-4112a2d0ffd9]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Flushing IO for device /dev/sde {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:27 user nova-compute[73029]: WARNING nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-8ac791ec-7eb0-4442-b465-48b912df2761 for instance with vm_state active and task_state deleting.
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-unplugged-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-13993caf-e057-46cb-b468-16a2ac962265 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:27 user nova-compute[73029]: WARNING nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-13993caf-e057-46cb-b468-16a2ac962265 for instance with vm_state active and task_state deleting.
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-unplugged-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-ee0d0456-d275-4932-a6ff-3de6fb281337 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:27 user nova-compute[73029]: WARNING nova.compute.manager [req-d6e61416-98d1-4e03-9068-1f483fa1c182 req-78bf0e7a-68e8-457d-a8cd-3df3c3fb19a0 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-ee0d0456-d275-4932-a6ff-3de6fb281337 for instance with vm_state active and task_state deleting.
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ced9aa-e823-4f0e-bb97-18fd017fd063]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[943ff276-3886-438c-bbae-7ffd461e8746]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-4ee226a2-f9d2-4055-8745-13664dffb75b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:28 user nova-compute[73029]: WARNING nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-4ee226a2-f9d2-4055-8745-13664dffb75b for instance with vm_state active and task_state deleting.
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-unplugged-cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-cca97791-958d-430b-9b6e-6125b2d4d28e for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-cca97791-958d-430b-9b6e-6125b2d4d28e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:28 user nova-compute[73029]: WARNING nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-cca97791-958d-430b-9b6e-6125b2d4d28e for instance with vm_state active and task_state deleting.
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-unplugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:28 user nova-compute[73029]: WARNING nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-c4677a60-3c27-4eb0-afa2-9f3d9be13600 for instance with vm_state active and task_state deleting.
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-unplugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ce7d3712-15c9-497d-9748-4d700bb13564 req-b3dea467-bb0d-4422-980e-07317f592894 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-unplugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] SCSI volumes sde have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0535cbc-2c93-482d-a54b-cd294a292826]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015.part --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.virt.images [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] b7358ad1-660e-450d-84f3-9a2c354213cf was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015.part /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d5a072-49c1-42d1-a369-e42ade6acbbf]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b, portal: 172.16.0.220,3260]
Aug 10 00:39:28 user nova-compute[73029]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b, portal: 172.16.0.220,3260] successful.
Aug 10 00:39:28 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206ac233-0162-487a-ae03-d7ffe340991b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.115s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3f9ebb-26de-4d5d-be7e-1e5806286c48]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.466s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] <== disconnect_volume: return (1467ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAeMJwBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:28 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[628032de-3fcb-4abc-ac58-077b4e4c9f51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dfa72f-5ee6-43b5-8f6c-ff82db3f79d0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:28 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:28 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:28 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:28 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:28 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:28 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:28 user nova-compute[73029]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 (non-flash)
Aug 10 00:39:28 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:28 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:28 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751c190d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71'): ({'sdf'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Removing single pathed devices sdf {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[edafb088-27b9-4b6a-9dbb-460e865dfc1a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0478a8c7-4fbf-4680-8538-344b4f1f1370]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Flushing IO for device /dev/sdf {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5a10a1-30a5-41f8-977e-e3cd6a169305]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:39:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.118s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8eb10e-1f13-4021-bc2a-c02045e7b591]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] SCSI volumes sdf have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e89dd-bd36-44b3-b0c2-c75e6edb16c2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015.part /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015.converted" returned: 0 in 0.570s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0d64e8-a3b0-4558-8bbe-00f546746dd6]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71, portal: 172.16.0.220,3260]
Aug 10 00:39:29 user nova-compute[73029]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71, portal: 172.16.0.220,3260] successful.
Aug 10 00:39:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: INFO nova.compute.manager [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Rebuilding instance
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f93fbaad-1f39-4dc2-8df3-2bfe5db12f71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbe7dec-a37c-4a66-b62e-ae4244dd42cd]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.522s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] <== disconnect_volume: return (525ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pABbxQGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba2331-555d-4e0a-bdd8-5ca5395e12a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "828496fb177a80cf95b71a60d6ad443c1ff9d015" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.989s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "828496fb177a80cf95b71a60d6ad443c1ff9d015" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "828496fb177a80cf95b71a60d6ad443c1ff9d015" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f31d2b-5acc-437e-84c3-626e0da83b6a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141bd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d'): ({'sdg'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Removing single pathed devices sdg {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e678faf6-3b15-4daf-ab89-97b587f3e61f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'trusted_certs' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54ec1ca-6cc4-41a5-9725-066c168d2305]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Flushing IO for device /dev/sdg {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb09629-6101-4ec0-9a18-7ff31377488e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-unplugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-unplugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:29 user nova-compute[73029]: WARNING nova.compute.manager [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-unplugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state active and task_state rescuing.
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:29 user nova-compute[73029]: WARNING nova.compute.manager [req-249b8cbd-9654-4e3f-ab98-73a7207abf2c req-26770f03-1f57-4f27-97cd-bc992bb894f7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state active and task_state rescuing.
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015 --force-share --output=json" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015,backing_fmt=raw /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.rescue {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[df49fcce-5f36-4502-9a14-5f1281f21d5d]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] SCSI volumes sdg have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015,backing_fmt=raw /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.rescue" returned: 0 in 0.056s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "828496fb177a80cf95b71a60d6ad443c1ff9d015" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'migration_context' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[577f892a-ad66-4ba6-8fa6-6ab1de0323a8]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Start _get_guest_xml network_info=[{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "vif_mac": "fa:16:3e:bb:10:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b7358ad1-660e-450d-84f3-9a2c354213cf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '4791d83e-086e-4d4f-9bb9-a2105ff5dd03', 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXgpkLDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4a17123b-6ea8-450b-9ada-8c8278dcf739', 'attached_at': '', 'detached_at': '', 'volume_id': '781b69f3-9c5f-461e-9a85-7812a66ef39c', 'serial': '781b69f3-9c5f-461e-9a85-7812a66ef39c'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'resources' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a0ee6c-b5dc-47b5-a03c-b246fa29b2ca]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d, portal: 172.16.0.220,3260]
Aug 10 00:39:29 user nova-compute[73029]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d, portal: 172.16.0.220,3260] successful.
Aug 10 00:39:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:39:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'pci_requests' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc45536-97ae-4580-b19d-9c2b447c626d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ba5705-8106-4b93-ad27-7c826b0c7cdd]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] <== disconnect_volume: return (429ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:39:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Deleting instance files /opt/stack/data/nova/instances/cc846d6c-027a-4a9a-819f-27919f3d2b25_del
Aug 10 00:39:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Deletion of /opt/stack/data/nova/instances/cc846d6c-027a-4a9a-819f-27919f3d2b25_del complete
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXgpkLDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:29 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'pci_devices' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'resources' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:29 user nova-compute[73029]: INFO nova.compute.manager [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Took 5.13 seconds to destroy the instance on the hypervisor.
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9674400a-fbf0-4aae-8d47-9c5dd9c48d8c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qXgpkLDz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'migration_context' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 10 00:39:29 user nova-compute[73029]: node.name = iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c
Aug 10 00:39:29 user nova-compute[73029]: node.tpgt = -1
Aug 10 00:39:29 user nova-compute[73029]: node.startup = automatic
Aug 10 00:39:29 user nova-compute[73029]: node.leading_login = No
Aug 10 00:39:29 user nova-compute[73029]: iface.iscsi_ifacename = default
Aug 10 00:39:29 user nova-compute[73029]: iface.net_ifacename = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.ipaddress = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.prefix_len = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.hwaddress = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.transport_name = tcp
Aug 10 00:39:29 user nova-compute[73029]: iface.initiatorname = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.state = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.vlan_id = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.vlan_priority = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.vlan_state = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.iface_num = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.mtu = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.port = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.bootproto = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.subnet_mask = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.gateway = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.dhcp_alt_client_id_state = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.dhcp_alt_client_id = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.dhcp_dns = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.dhcp_learn_iqn = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.dhcp_req_vendor_id_state = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.dhcp_vendor_id_state = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.dhcp_vendor_id = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.dhcp_slp_da = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.fragmentation = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.gratuitous_arp = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.incoming_forwarding = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.tos_state = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.tos = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.ttl = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.delayed_ack = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.tcp_nagle = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.tcp_wsf_state = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.tcp_wsf = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.tcp_timer_scale = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.tcp_timestamp = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.redirect = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.def_task_mgmt_timeout = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.header_digest = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.data_digest = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.immediate_data = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.initial_r2t = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.data_seq_inorder = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.data_pdu_inorder = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.erl = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.max_receive_data_len = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.first_burst_len = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.max_outstanding_r2t = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.max_burst_len = 0
Aug 10 00:39:29 user nova-compute[73029]: iface.chap_auth = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.bidi_chap = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.strict_login_compliance = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.discovery_auth = <empty>
Aug 10 00:39:29 user nova-compute[73029]: iface.discovery_logout = <empty>
Aug 10 00:39:29 user nova-compute[73029]: node.discovery_address = <empty>
Aug 10 00:39:29 user nova-compute[73029]: node.discovery_port = 0
Aug 10 00:39:29 user nova-compute[73029]: node.discovery_type = static
Aug 10 00:39:29 user nova-compute[73029]: node.session.initial_cmdsn = 0
Aug 10 00:39:29 user nova-compute[73029]: node.session.initial_login_retry_max = 8
Aug 10 00:39:29 user nova-compute[73029]: node.session.xmit_thread_priority = -20
Aug 10 00:39:29 user nova-compute[73029]: node.session.cmds_max = 128
Aug 10 00:39:29 user nova-compute[73029]: node.session.queue_depth = 32
Aug 10 00:39:29 user nova-compute[73029]: node.session.nr_sessions = 1
Aug 10 00:39:29 user nova-compute[73029]: node.session.auth.authmethod = CHAP
Aug 10 00:39:29 user nova-compute[73029]: node.session.auth.username = qXgpkLDz
Aug 10 00:39:29 user nova-compute[73029]: node.session.auth.password = ***
Aug 10 00:39:29 user nova-compute[73029]: node.session.auth.username_in = <empty>
Aug 10 00:39:29 user nova-compute[73029]: node.session.auth.password_in = <empty>
Aug 10 00:39:29 user nova-compute[73029]: node.session.auth.chap_algs = MD5
Aug 10 00:39:29 user nova-compute[73029]: node.session.timeo.replacement_timeout = 120
Aug 10 00:39:29 user nova-compute[73029]: node.session.err_timeo.abort_timeout = 15
Aug 10 00:39:29 user nova-compute[73029]: node.session.err_timeo.lu_reset_timeout = 30
Aug 10 00:39:29 user nova-compute[73029]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 10 00:39:29 user nova-compute[73029]: node.session.err_timeo.host_reset_timeout = 60
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.FastAbort = Yes
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.InitialR2T = No
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.ImmediateData = Yes
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.FirstBurstLength = 262144
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.MaxBurstLength = 16776192
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.DefaultTime2Retain = 0
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.DefaultTime2Wait = 2
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.MaxConnections = 1
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 10 00:39:29 user nova-compute[73029]: node.session.iscsi.ERL = 0
Aug 10 00:39:29 user nova-compute[73029]: node.session.scan = manual
Aug 10 00:39:29 user nova-compute[73029]: node.session.reopen_max = 0
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].address = 172.16.0.220
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].port = 3260
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].startup = manual
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].tcp.window_size = 524288
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].tcp.type_of_service = 0
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].timeo.logout_timeout = 15
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].timeo.login_timeout = 15
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].timeo.auth_timeout = 45
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].timeo.noop_out_interval = 5
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].timeo.noop_out_timeout = 5
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].iscsi.HeaderDigest = None
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].iscsi.DataDigest = None
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].iscsi.IFMarker = No
Aug 10 00:39:29 user nova-compute[73029]: node.conn[0].iscsi.OFMarker = No
Aug 10 00:39:29 user nova-compute[73029]: # END RECORD
Aug 10 00:39:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73029) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a0a93-8525-49e7-9092-fe789a1c79ed]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb8345-7248-4bf8-96ed-76c84c26d215]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXgpkLDz {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXgpkLDz" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[47effa55-5edb-4877-a346-eee9056f9471]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qXgpkLDz'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[214475a2-2cee-42f4-a34d-afc0f4ea0f93]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a05f349-b0c7-4229-a01a-cbfd6954eede req-335a432c-b6b6-498a-857e-4e41afa3f7e9 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-plugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a05f349-b0c7-4229-a01a-cbfd6954eede req-335a432c-b6b6-498a-857e-4e41afa3f7e9 service nova] Acquiring lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a05f349-b0c7-4229-a01a-cbfd6954eede req-335a432c-b6b6-498a-857e-4e41afa3f7e9 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a05f349-b0c7-4229-a01a-cbfd6954eede req-335a432c-b6b6-498a-857e-4e41afa3f7e9 service nova] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a05f349-b0c7-4229-a01a-cbfd6954eede req-335a432c-b6b6-498a-857e-4e41afa3f7e9 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] No waiting events found dispatching network-vif-plugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:29 user nova-compute[73029]: WARNING nova.compute.manager [req-6a05f349-b0c7-4229-a01a-cbfd6954eede req-335a432c-b6b6-498a-857e-4e41afa3f7e9 service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received unexpected event network-vif-plugged-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 for instance with vm_state active and task_state deleting.
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1098759-e904-4328-b29a-72a499a1a71a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:29 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.214s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[da631199-7997-4354-82b3-b39cf96122f1]: (4, ('0 0 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXgpkLDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.251s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] <== connect_volume: return (253ms) {'type': 'block', 'scsi_wwn': '23337366562383633', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337366562383633', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:39:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-691660506',display_name='tempest-ServerStableDeviceRescueTest-server-691660506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-691660506',id=3,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2qMclUiDDtfdBQQEFJIJT7zei+fvBSFEd1IVsKrxuITgVneSkV8lM0t15+OyE3mgphGmJcPu/oAK76jlQjN7i12XxfI3xmn+chXoTRAs6YW2/irdffyhbV6xNXZ7tXIA==',key_name='tempest-keypair-1474595581',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:35:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='475e002776ae4e2e994cc801872bcfad',ramdisk_id='',reservation_id='r-42a5wi0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-757302542',owner_user_name='tempest-ServerStableDeviceRescueTest-757302542-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7a69e6bcbf4ce3a0867b4f51564377',uuid=4a17123b-6ea8-450b-9ada-8c8278dcf739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "vif_mac": "fa:16:3e:bb:10:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:39:30 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Converting VIF {"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "vif_mac": "fa:16:3e:bb:10:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:30 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:10:a5,bridge_name='br-int',has_traffic_filtering=True,id=ce93d51f-3ef0-48a2-b705-1a2d12fcccac,network=Network(ada601a5-86a5-4382-b1e3-b53be3e6364f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce93d51f-3e') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:30 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:39:30 user nova-compute[73029]:   <uuid>4a17123b-6ea8-450b-9ada-8c8278dcf739</uuid>
Aug 10 00:39:30 user nova-compute[73029]:   <name>instance-00000003</name>
Aug 10 00:39:30 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:39:30 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:39:30 user nova-compute[73029]:   <metadata>
Aug 10 00:39:30 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:39:30 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:39:30 user nova-compute[73029]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-691660506</nova:name>
Aug 10 00:39:30 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:39:29</nova:creationTime>
Aug 10 00:39:30 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:39:30 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:39:30 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:39:30 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:39:30 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:39:30 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:39:30 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:39:30 user nova-compute[73029]:       <nova:owner>
Aug 10 00:39:30 user nova-compute[73029]:         <nova:user uuid="7b7a69e6bcbf4ce3a0867b4f51564377">tempest-ServerStableDeviceRescueTest-757302542-project-member</nova:user>
Aug 10 00:39:30 user nova-compute[73029]:         <nova:project uuid="475e002776ae4e2e994cc801872bcfad">tempest-ServerStableDeviceRescueTest-757302542</nova:project>
Aug 10 00:39:30 user nova-compute[73029]:       </nova:owner>
Aug 10 00:39:30 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:39:30 user nova-compute[73029]:       <nova:ports>
Aug 10 00:39:30 user nova-compute[73029]:         <nova:port uuid="ce93d51f-3ef0-48a2-b705-1a2d12fcccac">
Aug 10 00:39:30 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 10 00:39:30 user nova-compute[73029]:         </nova:port>
Aug 10 00:39:30 user nova-compute[73029]:       </nova:ports>
Aug 10 00:39:30 user nova-compute[73029]:     </nova:instance>
Aug 10 00:39:30 user nova-compute[73029]:   </metadata>
Aug 10 00:39:30 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:39:30 user nova-compute[73029]:     <system>
Aug 10 00:39:30 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:39:30 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:39:30 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:39:30 user nova-compute[73029]:       <entry name="serial">4a17123b-6ea8-450b-9ada-8c8278dcf739</entry>
Aug 10 00:39:30 user nova-compute[73029]:       <entry name="uuid">4a17123b-6ea8-450b-9ada-8c8278dcf739</entry>
Aug 10 00:39:30 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:39:30 user nova-compute[73029]:     </system>
Aug 10 00:39:30 user nova-compute[73029]:   </sysinfo>
Aug 10 00:39:30 user nova-compute[73029]:   <os>
Aug 10 00:39:30 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:39:30 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:39:30 user nova-compute[73029]:   </os>
Aug 10 00:39:30 user nova-compute[73029]:   <features>
Aug 10 00:39:30 user nova-compute[73029]:     <acpi/>
Aug 10 00:39:30 user nova-compute[73029]:     <apic/>
Aug 10 00:39:30 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:39:30 user nova-compute[73029]:   </features>
Aug 10 00:39:30 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:39:30 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:39:30 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:39:30 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:39:30 user nova-compute[73029]:   </clock>
Aug 10 00:39:30 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:39:30 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:39:30 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:39:30 user nova-compute[73029]:   </cpu>
Aug 10 00:39:30 user nova-compute[73029]:   <devices>
Aug 10 00:39:30 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:39:30 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:39:30 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk"/>
Aug 10 00:39:30 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:39:30 user nova-compute[73029]:     </disk>
Aug 10 00:39:30 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:39:30 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:39:30 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 00:39:30 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:39:30 user nova-compute[73029]:       <serial>781b69f3-9c5f-461e-9a85-7812a66ef39c</serial>
Aug 10 00:39:30 user nova-compute[73029]:     </disk>
Aug 10 00:39:30 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:39:30 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:39:30 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.rescue"/>
Aug 10 00:39:30 user nova-compute[73029]:       <target dev="vdc" bus="virtio"/>
Aug 10 00:39:30 user nova-compute[73029]:       <boot order="1"/>
Aug 10 00:39:30 user nova-compute[73029]:     </disk>
Aug 10 00:39:30 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:39:30 user nova-compute[73029]:       <mac address="fa:16:3e:bb:10:a5"/>
Aug 10 00:39:30 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:39:30 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:39:30 user nova-compute[73029]:       <target dev="tapce93d51f-3e"/>
Aug 10 00:39:30 user nova-compute[73029]:     </interface>
Aug 10 00:39:30 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:39:30 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/console.log" append="off"/>
Aug 10 00:39:30 user nova-compute[73029]:     </serial>
Aug 10 00:39:30 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:39:30 user nova-compute[73029]:     <video>
Aug 10 00:39:30 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:39:30 user nova-compute[73029]:     </video>
Aug 10 00:39:30 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:39:30 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:39:30 user nova-compute[73029]:     </rng>
Aug 10 00:39:30 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:39:30 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:39:30 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:39:30 user nova-compute[73029]:     </memballoon>
Aug 10 00:39:30 user nova-compute[73029]:   </devices>
Aug 10 00:39:30 user nova-compute[73029]: </domain>
Aug 10 00:39:30 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:39:30 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Instance destroyed successfully.
Aug 10 00:39:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:39:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:39:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:39:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] No VIF found with MAC fa:16:3e:bb:10:a5, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:39:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Instance destroyed successfully.
Aug 10 00:39:31 user nova-compute[73029]: INFO nova.compute.manager [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Detaching volume 85bd054b-8da1-42f8-b7b5-404ba7974bc5
Aug 10 00:39:31 user nova-compute[73029]: INFO nova.virt.block_device [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Attempting to driver detach volume 85bd054b-8da1-42f8-b7b5-404ba7974bc5 from mountpoint /dev/vdb
Aug 10 00:39:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Attempting to detach device vdb from instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:39:31 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:39:31 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 00:39:31 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:39:31 user nova-compute[73029]:   <serial>85bd054b-8da1-42f8-b7b5-404ba7974bc5</serial>
Aug 10 00:39:31 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:39:31 user nova-compute[73029]: </disk>
Aug 10 00:39:31 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:39:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully detached device vdb from instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f from the persistent domain config.
Aug 10 00:39:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXucSwLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:31 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3984cb9-8f96-49dd-a037-38446e41684b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b823e8-ecd1-49ea-b12d-ecc563533401]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:31 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:31 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:31 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:31 user nova-compute[73029]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:31 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:31 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7527593640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bf2dc9-3bd5-482b-a76f-6e2f823e732c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[895dd532-10ca-4bfb-9184-5d6bd3c099b1]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a22644-0dce-46f0-81c8-fa1a0240d775]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59ea5d9-fc1f-46ce-b1d6-dadec8a78f67]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1992e14c-e7ce-427f-bea1-1f82675cd6fd]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-unplugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] No waiting events found dispatching network-vif-unplugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:31 user nova-compute[73029]: WARNING nova.compute.manager [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received unexpected event network-vif-unplugged-756092b1-bc75-4163-a66c-ecaff9bcb39d for instance with vm_state active and task_state rebuilding.
Aug 10 00:39:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] No waiting events found dispatching network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:31 user nova-compute[73029]: WARNING nova.compute.manager [req-cbd46cea-276f-4da2-891b-d187023a9358 req-90b158bf-f25d-412a-b03c-952d631ce525 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received unexpected event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d for instance with vm_state active and task_state rebuilding.
Aug 10 00:39:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2990b88b-89dc-4b1b-aad7-5045d2c1316e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260]
Aug 10 00:39:32 user nova-compute[73029]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260] successful.
Aug 10 00:39:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07e96c4-9024-45c1-bea5-a1c897263369]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== disconnect_volume: return (359ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-f723ddc2-dd30-4a4d-9897-cf8571315adb req-fa1afa88-662e-4e64-8de1-fe95837b633f service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-deleted-8ac791ec-7eb0-4442-b465-48b912df2761 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:32 user nova-compute[73029]: INFO nova.compute.manager [req-f723ddc2-dd30-4a4d-9897-cf8571315adb req-fa1afa88-662e-4e64-8de1-fe95837b633f service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Neutron deleted interface 8ac791ec-7eb0-4442-b465-48b912df2761; detaching it from the instance and deleting it from the info cache
Aug 10 00:39:32 user nova-compute[73029]: DEBUG nova.network.neutron [req-f723ddc2-dd30-4a4d-9897-cf8571315adb req-fa1afa88-662e-4e64-8de1-fe95837b633f service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [{"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee0d0456-d275-4932-a6ff-3de6fb281337", "address": "fa:16:3e:01:07:a7", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0d0456-d2", "ovs_interfaceid": "ee0d0456-d275-4932-a6ff-3de6fb281337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-f723ddc2-dd30-4a4d-9897-cf8571315adb req-fa1afa88-662e-4e64-8de1-fe95837b633f service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Detach interface failed, port_id=8ac791ec-7eb0-4442-b465-48b912df2761, reason: Instance cc846d6c-027a-4a9a-819f-27919f3d2b25 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:33 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Instance destroyed successfully.
Aug 10 00:39:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2093299035',display_name='tempest-ServerActionsTestOtherA-server-1126399829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2093299035',id=2,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:35:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-1q6bgm1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=ee3b2f60-0756-4d77-97ac-11fa0c456c1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_vif [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap756092b1-bc, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:33 user nova-compute[73029]: INFO os_vif [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc')
Aug 10 00:39:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXucSwLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:33 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e684210-c7cc-4546-b3f1-ec6d2324c78e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d8b1d1-7103-41cd-9152-6c57046f9c1c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:33 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:33 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:33 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:33 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141bc9d0>, {}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Disconnecting from: [] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== disconnect_volume: return (56ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:39:33 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Deleting instance files /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f_del
Aug 10 00:39:33 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Deletion of /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f_del complete
Aug 10 00:39:33 user nova-compute[73029]: INFO nova.virt.block_device [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Booting with volume 85bd054b-8da1-42f8-b7b5-404ba7974bc5 at /dev/vdb
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.utils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd2834-d40a-443a-8d3e-531f3b9fc3fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc46f596-10a1-4c94-8dc9-adbdeadcc003]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6196e59a-7b5d-45b8-bb91-02fa9f626065]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8522808b-449b-432f-9937-63767369d9f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:39:33 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:39:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fdddf0-215c-48ab-a695-2c8219b34c06]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG os_brick.utils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:33 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating existing volume attachment record: 79920827-661a-45a3-a7ea-286b8fac3e1e {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b0908eb3-094a-452d-9f7f-3f31cd2541ad tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 4a17123b-6ea8-450b-9ada-8c8278dcf739 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627974.9220772, 4a17123b-6ea8-450b-9ada-8c8278dcf739 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:34 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] VM Resumed (Lifecycle Event)
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:34 user nova-compute[73029]: WARNING nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state active and task_state rescuing.
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:34 user nova-compute[73029]: WARNING nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state active and task_state rescuing.
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-deleted-ee0d0456-d275-4932-a6ff-3de6fb281337 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:34 user nova-compute[73029]: INFO nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Neutron deleted interface ee0d0456-d275-4932-a6ff-3de6fb281337; detaching it from the instance and deleting it from the info cache
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [{"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "address": "fa:16:3e:13:d3:66", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4677a60-3c", "ovs_interfaceid": "c4677a60-3c27-4eb0-afa2-9f3d9be13600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Detach interface failed, port_id=ee0d0456-d275-4932-a6ff-3de6fb281337, reason: Instance cc846d6c-027a-4a9a-819f-27919f3d2b25 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-deleted-c4677a60-3c27-4eb0-afa2-9f3d9be13600 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:35 user nova-compute[73029]: INFO nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Neutron deleted interface c4677a60-3c27-4eb0-afa2-9f3d9be13600; detaching it from the instance and deleting it from the info cache
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.network.neutron [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [{"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "address": "fa:16:3e:80:69:f8", "network": {"id": "e79cc939-ac35-4337-ada6-e3adbda5c9ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-819685296", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cdd5d6a-c5", "ovs_interfaceid": "5cdd5d6a-c5a5-491f-8dc9-f0494a413de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627974.922292, 4a17123b-6ea8-450b-9ada-8c8278dcf739 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] VM Started (Lifecycle Event)
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Detach interface failed, port_id=c4677a60-3c27-4eb0-afa2-9f3d9be13600, reason: Instance cc846d6c-027a-4a9a-819f-27919f3d2b25 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-deleted-5cdd5d6a-c5a5-491f-8dc9-f0494a413de5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:35 user nova-compute[73029]: INFO nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Neutron deleted interface 5cdd5d6a-c5a5-491f-8dc9-f0494a413de5; detaching it from the instance and deleting it from the info cache
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.network.neutron [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [{"id": "4ee226a2-f9d2-4055-8745-13664dffb75b", "address": "fa:16:3e:13:76:4e", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee226a2-f9", "ovs_interfaceid": "4ee226a2-f9d2-4055-8745-13664dffb75b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cca97791-958d-430b-9b6e-6125b2d4d28e", "address": "fa:16:3e:72:46:e7", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca97791-95", "ovs_interfaceid": "cca97791-958d-430b-9b6e-6125b2d4d28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13993caf-e057-46cb-b468-16a2ac962265", "address": "fa:16:3e:d8:b4:54", "network": {"id": "99b45c17-aa00-4894-8466-93dedbfcdf75", "bridge": "br-int", "label": "tempest-device-tagging-net1-2117284996", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f2f4204aa7a2494c9233a97287b929da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13993caf-e0", "ovs_interfaceid": "13993caf-e057-46cb-b468-16a2ac962265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d419ed3-7fb7-4d5c-a8dc-2e05d4e66a87 req-a8b81fe0-098c-45dd-bbad-c42ae6823e7d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Detach interface failed, port_id=5cdd5d6a-c5a5-491f-8dc9-f0494a413de5, reason: Instance cc846d6c-027a-4a9a-819f-27919f3d2b25 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:39:35 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:35 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Took 5.61 seconds to deallocate network for instance.
Aug 10 00:39:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-0877e761-35ac-48cd-b9b0-d5ee99afab6b req-c54c68a6-a509-44ac-85d2-f6a8221c8a1d service nova] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Received event network-vif-deleted-13993caf-e057-46cb-b468-16a2ac962265 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-ed569cdf-7320-45c5-af08-9ad4297e89ce req-5ef1a016-35fc-4966-add5-852344e34790 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received event network-changed-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-ed569cdf-7320-45c5-af08-9ad4297e89ce req-5ef1a016-35fc-4966-add5-852344e34790 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Refreshing instance network info cache due to event network-changed-50401080-b849-490d-a207-e48fa5eaf26d. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ed569cdf-7320-45c5-af08-9ad4297e89ce req-5ef1a016-35fc-4966-add5-852344e34790 service nova] Acquiring lock "refresh_cache-f1561416-585d-4d7d-a1d7-86a64cf00630" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ed569cdf-7320-45c5-af08-9ad4297e89ce req-5ef1a016-35fc-4966-add5-852344e34790 service nova] Acquired lock "refresh_cache-f1561416-585d-4d7d-a1d7-86a64cf00630" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG nova.network.neutron [req-ed569cdf-7320-45c5-af08-9ad4297e89ce req-5ef1a016-35fc-4966-add5-852344e34790 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Refreshing network info cache for port 50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:38 user nova-compute[73029]: INFO nova.compute.manager [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Terminating instance
Aug 10 00:39:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:38 user nova-compute[73029]: INFO nova.compute.manager [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Took 3.07 seconds to detach 3 volumes for instance.
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "f1561416-585d-4d7d-a1d7-86a64cf00630" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:38 user nova-compute[73029]: INFO nova.compute.manager [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Terminating instance
Aug 10 00:39:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:38 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:39:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Instance destroyed successfully.
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lazy-loading 'resources' on Instance uuid dc191a1a-b684-4b2a-8cee-0572a6396b0d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2063515216',display_name='tempest-VolumesActionsTest-instance-2063515216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2063515216',id=12,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db8d6b005e844e3b1232942bf67fb9a',ramdisk_id='',reservation_id='r-33iepqwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-261338927',owner_user_name='tempest-VolumesActionsTest-261338927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:57Z,user_data=None,user_id='9c16b4b3e2e34e5e9e53dcfaf4b948dd',uuid=dc191a1a-b684-4b2a-8cee-0572a6396b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converting VIF {"id": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "address": "fa:16:3e:43:f3:22", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bb0ebb-56", "ovs_interfaceid": "a7bb0ebb-56fd-40db-becc-bcf28fc8749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:f3:22,bridge_name='br-int',has_traffic_filtering=True,id=a7bb0ebb-56fd-40db-becc-bcf28fc8749b,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bb0ebb-56') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG os_vif [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:f3:22,bridge_name='br-int',has_traffic_filtering=True,id=a7bb0ebb-56fd-40db-becc-bcf28fc8749b,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bb0ebb-56') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7bb0ebb-56, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.617s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:39 user nova-compute[73029]: INFO os_vif [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:f3:22,bridge_name='br-int',has_traffic_filtering=True,id=a7bb0ebb-56fd-40db-becc-bcf28fc8749b,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bb0ebb-56')
Aug 10 00:39:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Deleting instance files /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d_del
Aug 10 00:39:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Deletion of /opt/stack/data/nova/instances/dc191a1a-b684-4b2a-8cee-0572a6396b0d_del complete
Aug 10 00:39:39 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Deleted allocations for instance cc846d6c-027a-4a9a-819f-27919f3d2b25
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:39 user nova-compute[73029]: INFO nova.compute.manager [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 10 00:39:39 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-87cfcd69-0586-4548-9342-bfba3e915836 req-59233fdc-9190-4c5a-a276-b713e0d380c1 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received event network-vif-unplugged-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-87cfcd69-0586-4548-9342-bfba3e915836 req-59233fdc-9190-4c5a-a276-b713e0d380c1 service nova] Acquiring lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-87cfcd69-0586-4548-9342-bfba3e915836 req-59233fdc-9190-4c5a-a276-b713e0d380c1 service nova] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-87cfcd69-0586-4548-9342-bfba3e915836 req-59233fdc-9190-4c5a-a276-b713e0d380c1 service nova] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-87cfcd69-0586-4548-9342-bfba3e915836 req-59233fdc-9190-4c5a-a276-b713e0d380c1 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] No waiting events found dispatching network-vif-unplugged-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-87cfcd69-0586-4548-9342-bfba3e915836 req-59233fdc-9190-4c5a-a276-b713e0d380c1 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received event network-vif-unplugged-50401080-b849-490d-a207-e48fa5eaf26d for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.network.neutron [req-ed569cdf-7320-45c5-af08-9ad4297e89ce req-5ef1a016-35fc-4966-add5-852344e34790 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Updated VIF entry in instance network info cache for port 50401080-b849-490d-a207-e48fa5eaf26d. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.network.neutron [req-ed569cdf-7320-45c5-af08-9ad4297e89ce req-5ef1a016-35fc-4966-add5-852344e34790 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Updating instance_info_cache with network_info: [{"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f42613a4-57ce-4951-bb20-06aec6828d5f tempest-TaggedBootDevicesTest-417793474 tempest-TaggedBootDevicesTest-417793474-project-member] Lock "cc846d6c-027a-4a9a-819f-27919f3d2b25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.796s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ed569cdf-7320-45c5-af08-9ad4297e89ce req-5ef1a016-35fc-4966-add5-852344e34790 service nova] Releasing lock "refresh_cache-f1561416-585d-4d7d-a1d7-86a64cf00630" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:39:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Instance destroyed successfully.
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'resources' on Instance uuid f1561416-585d-4d7d-a1d7-86a64cf00630 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-797632932',display_name='tempest-AttachVolumeNegativeTest-server-797632932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-797632932',id=13,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJqlT/TO2f5THRie2gUu0eZRSTF/ZSx3kThepwp7LKb13Uqrk1O0pB4ZAOCWWKQ5BXT647rl+w8+EeHkOV5gMklo2G/y3Vp5XUTDeY45eL7EGuj+7Z6Sd5LJJMFk17Yig==',key_name='tempest-keypair-1660648565',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:37:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-zzgik21r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=f1561416-585d-4d7d-a1d7-86a64cf00630,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "50401080-b849-490d-a207-e48fa5eaf26d", "address": "fa:16:3e:9e:6b:06", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50401080-b8", "ovs_interfaceid": "50401080-b849-490d-a207-e48fa5eaf26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:06,bridge_name='br-int',has_traffic_filtering=True,id=50401080-b849-490d-a207-e48fa5eaf26d,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50401080-b8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG os_vif [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:06,bridge_name='br-int',has_traffic_filtering=True,id=50401080-b849-490d-a207-e48fa5eaf26d,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50401080-b8') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50401080-b8, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:39 user nova-compute[73029]: INFO os_vif [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:06,bridge_name='br-int',has_traffic_filtering=True,id=50401080-b849-490d-a207-e48fa5eaf26d,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50401080-b8')
Aug 10 00:39:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Deleting instance files /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630_del
Aug 10 00:39:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Deletion of /opt/stack/data/nova/instances/f1561416-585d-4d7d-a1d7-86a64cf00630_del complete
Aug 10 00:39:39 user nova-compute[73029]: INFO nova.compute.manager [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 10 00:39:39 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:39:39 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received event network-vif-unplugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] Acquiring lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] No waiting events found dispatching network-vif-unplugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received event network-vif-unplugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received event network-vif-plugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] Acquiring lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] No waiting events found dispatching network-vif-plugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:40 user nova-compute[73029]: WARNING nova.compute.manager [req-1209ef39-5224-4e9c-8ae2-162b933ccb5b req-86381cd8-06ea-40f0-8c2b-b889f9afece0 service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received unexpected event network-vif-plugged-a7bb0ebb-56fd-40db-becc-bcf28fc8749b for instance with vm_state active and task_state deleting.
Aug 10 00:39:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-53c5b42f-4711-429c-9ebb-b7044f2a1a64 req-1d1c25f0-0d3b-42f2-8e1f-637f6e82919c service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received event network-vif-plugged-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-53c5b42f-4711-429c-9ebb-b7044f2a1a64 req-1d1c25f0-0d3b-42f2-8e1f-637f6e82919c service nova] Acquiring lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-53c5b42f-4711-429c-9ebb-b7044f2a1a64 req-1d1c25f0-0d3b-42f2-8e1f-637f6e82919c service nova] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-53c5b42f-4711-429c-9ebb-b7044f2a1a64 req-1d1c25f0-0d3b-42f2-8e1f-637f6e82919c service nova] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-53c5b42f-4711-429c-9ebb-b7044f2a1a64 req-1d1c25f0-0d3b-42f2-8e1f-637f6e82919c service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] No waiting events found dispatching network-vif-plugged-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:41 user nova-compute[73029]: WARNING nova.compute.manager [req-53c5b42f-4711-429c-9ebb-b7044f2a1a64 req-1d1c25f0-0d3b-42f2-8e1f-637f6e82919c service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received unexpected event network-vif-plugged-50401080-b849-490d-a207-e48fa5eaf26d for instance with vm_state active and task_state deleting.
Aug 10 00:39:41 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627966.449915, cc846d6c-027a-4a9a-819f-27919f3d2b25 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:41 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] VM Stopped (Lifecycle Event)
Aug 10 00:39:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-d5be24a5-35a8-4a2d-aa6d-c86f55a4e232 None None] [instance: cc846d6c-027a-4a9a-819f-27919f3d2b25] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:41 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:41 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Took 2.19 seconds to deallocate network for instance.
Aug 10 00:39:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-dbd8f24d-61b2-457e-9ebb-41f570dfb2f5 req-2bba47da-c7fb-4884-9e47-da46fd7bd8ea service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Received event network-vif-deleted-a7bb0ebb-56fd-40db-becc-bcf28fc8749b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:41 user nova-compute[73029]: INFO nova.compute.manager [req-dbd8f24d-61b2-457e-9ebb-41f570dfb2f5 req-2bba47da-c7fb-4884-9e47-da46fd7bd8ea service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Neutron deleted interface a7bb0ebb-56fd-40db-becc-bcf28fc8749b; detaching it from the instance and deleting it from the info cache
Aug 10 00:39:41 user nova-compute[73029]: DEBUG nova.network.neutron [req-dbd8f24d-61b2-457e-9ebb-41f570dfb2f5 req-2bba47da-c7fb-4884-9e47-da46fd7bd8ea service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-dbd8f24d-61b2-457e-9ebb-41f570dfb2f5 req-2bba47da-c7fb-4884-9e47-da46fd7bd8ea service nova] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Detach interface failed, port_id=a7bb0ebb-56fd-40db-becc-bcf28fc8749b, reason: Instance dc191a1a-b684-4b2a-8cee-0572a6396b0d could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:39:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:42 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:39:42 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:39:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.667s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:42 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:39:42 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Deleted allocations for instance dc191a1a-b684-4b2a-8cee-0572a6396b0d
Aug 10 00:39:42 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Took 2.74 seconds to deallocate network for instance.
Aug 10 00:39:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a5b8b93-30fd-4357-a4f6-769e1217955b tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "dc191a1a-b684-4b2a-8cee-0572a6396b0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.379s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:42 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:39:42 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:39:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:43 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Deleted allocations for instance f1561416-585d-4d7d-a1d7-86a64cf00630
Aug 10 00:39:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a051171-3633-4651-8eb0-98540666e279 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "f1561416-585d-4d7d-a1d7-86a64cf00630" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.463s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-8b09964c-410f-4f38-8178-45f55578ce37 req-bf1e1e1a-3529-4340-a7de-0945873f12f8 service nova] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Received event network-vif-deleted-50401080-b849-490d-a207-e48fa5eaf26d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:39:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Creating image(s)
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.158s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.171s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk 1073741824" returned: 0 in 0.061s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.183s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Cannot resize image /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Ensure instance console log exists: /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Start _get_guest_xml network_info=[{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '79920827-661a-45a3-a7ea-286b8fac3e1e', 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXucSwLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee3b2f60-0756-4d77-97ac-11fa0c456c1f', 'attached_at': '', 'detached_at': '', 'volume_id': '85bd054b-8da1-42f8-b7b5-404ba7974bc5', 'serial': '85bd054b-8da1-42f8-b7b5-404ba7974bc5'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:39:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 10 00:39:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.objects.instance [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627971.2626498, ee3b2f60-0756-4d77-97ac-11fa0c456c1f => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:46 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] VM Stopped (Lifecycle Event)
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXucSwLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:39:46 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:46 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:39:46 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:39:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8fdccdd2-fe7e-499a-95ac-c3bcb72b01d4 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8144fa-3910-45b2-b771-552a4f0c3a0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:39:46 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e2a80a-cccb-4b93-8db1-d46b085cebd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5] added
Aug 10 00:39:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee568091-5079-4bb9-9074-a99087e4f887]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0803826-59b2-4b67-98ab-88c16d14e712]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXucSwLQ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXucSwLQ" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdabb398-4a8d-494a-a5d2-aa079bacc412]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qXucSwLQ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d18ad9d-d1f6-44d3-aa6e-9703db511003]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f2714-0d96-4ee7-809a-a2733adf9cb2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:46 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:46 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a97e94e-26be-44a1-9e46-ae2618c13c75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260]
Aug 10 00:39:46 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260] successful.
Aug 10 00:39:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaf4029-1d07-437a-a966-613d470a16cd]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d267251-8c2e-497a-970f-83bce7f591bb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:46 user nova-compute[73029]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:46 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:39:46 user nova-compute[73029]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:39:46 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:39:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12c4f55-3be7-41d4-b205-bcc7888a4778]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXucSwLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:39:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23137633435616336', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137633435616336', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2093299035',display_name='tempest-ServerActionsTestOtherA-server-1126399829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2093299035',id=2,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:35:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-1q6bgm1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=ee3b2f60-0756-4d77-97ac-11fa0c456c1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:39:47 user nova-compute[73029]:   <uuid>ee3b2f60-0756-4d77-97ac-11fa0c456c1f</uuid>
Aug 10 00:39:47 user nova-compute[73029]:   <name>instance-00000002</name>
Aug 10 00:39:47 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:39:47 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:39:47 user nova-compute[73029]:   <metadata>
Aug 10 00:39:47 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:39:47 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:39:47 user nova-compute[73029]:       <nova:name>tempest-ServerActionsTestOtherA-server-1126399829</nova:name>
Aug 10 00:39:47 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:39:46</nova:creationTime>
Aug 10 00:39:47 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:39:47 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:39:47 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:39:47 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:39:47 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:39:47 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:39:47 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:39:47 user nova-compute[73029]:       <nova:owner>
Aug 10 00:39:47 user nova-compute[73029]:         <nova:user uuid="066b8c956dd146209ae7ecabfbf083ff">tempest-ServerActionsTestOtherA-916478349-project-member</nova:user>
Aug 10 00:39:47 user nova-compute[73029]:         <nova:project uuid="60aabdbd31b647d68db993c0a60a43ec">tempest-ServerActionsTestOtherA-916478349</nova:project>
Aug 10 00:39:47 user nova-compute[73029]:       </nova:owner>
Aug 10 00:39:47 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:39:47 user nova-compute[73029]:       <nova:ports>
Aug 10 00:39:47 user nova-compute[73029]:         <nova:port uuid="756092b1-bc75-4163-a66c-ecaff9bcb39d">
Aug 10 00:39:47 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 00:39:47 user nova-compute[73029]:         </nova:port>
Aug 10 00:39:47 user nova-compute[73029]:       </nova:ports>
Aug 10 00:39:47 user nova-compute[73029]:     </nova:instance>
Aug 10 00:39:47 user nova-compute[73029]:   </metadata>
Aug 10 00:39:47 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:39:47 user nova-compute[73029]:     <system>
Aug 10 00:39:47 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:39:47 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:39:47 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:39:47 user nova-compute[73029]:       <entry name="serial">ee3b2f60-0756-4d77-97ac-11fa0c456c1f</entry>
Aug 10 00:39:47 user nova-compute[73029]:       <entry name="uuid">ee3b2f60-0756-4d77-97ac-11fa0c456c1f</entry>
Aug 10 00:39:47 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:39:47 user nova-compute[73029]:     </system>
Aug 10 00:39:47 user nova-compute[73029]:   </sysinfo>
Aug 10 00:39:47 user nova-compute[73029]:   <os>
Aug 10 00:39:47 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:39:47 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:39:47 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:39:47 user nova-compute[73029]:   </os>
Aug 10 00:39:47 user nova-compute[73029]:   <features>
Aug 10 00:39:47 user nova-compute[73029]:     <acpi/>
Aug 10 00:39:47 user nova-compute[73029]:     <apic/>
Aug 10 00:39:47 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:39:47 user nova-compute[73029]:   </features>
Aug 10 00:39:47 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:39:47 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:39:47 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:39:47 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:39:47 user nova-compute[73029]:   </clock>
Aug 10 00:39:47 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:39:47 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:39:47 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:39:47 user nova-compute[73029]:   </cpu>
Aug 10 00:39:47 user nova-compute[73029]:   <devices>
Aug 10 00:39:47 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:39:47 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:39:47 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk"/>
Aug 10 00:39:47 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:39:47 user nova-compute[73029]:     </disk>
Aug 10 00:39:47 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:39:47 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:39:47 user nova-compute[73029]:       <source dev="/dev/sdc"/>
Aug 10 00:39:47 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:39:47 user nova-compute[73029]:       <serial>85bd054b-8da1-42f8-b7b5-404ba7974bc5</serial>
Aug 10 00:39:47 user nova-compute[73029]:     </disk>
Aug 10 00:39:47 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:39:47 user nova-compute[73029]:       <mac address="fa:16:3e:16:10:6b"/>
Aug 10 00:39:47 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:39:47 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:39:47 user nova-compute[73029]:       <target dev="tap756092b1-bc"/>
Aug 10 00:39:47 user nova-compute[73029]:     </interface>
Aug 10 00:39:47 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:39:47 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/console.log" append="off"/>
Aug 10 00:39:47 user nova-compute[73029]:     </serial>
Aug 10 00:39:47 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:39:47 user nova-compute[73029]:     <video>
Aug 10 00:39:47 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:39:47 user nova-compute[73029]:     </video>
Aug 10 00:39:47 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:39:47 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:39:47 user nova-compute[73029]:     </rng>
Aug 10 00:39:47 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:39:47 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:39:47 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:39:47 user nova-compute[73029]:     </memballoon>
Aug 10 00:39:47 user nova-compute[73029]:   </devices>
Aug 10 00:39:47 user nova-compute[73029]: </domain>
Aug 10 00:39:47 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2093299035',display_name='tempest-ServerActionsTestOtherA-server-1126399829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2093299035',id=2,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:35:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-1q6bgm1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=ee3b2f60-0756-4d77-97ac-11fa0c456c1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG os_vif [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap756092b1-bc, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap756092b1-bc, col_values=(('external_ids', {'iface-id': '756092b1-bc75-4163-a66c-ecaff9bcb39d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:10:6b', 'vm-uuid': 'ee3b2f60-0756-4d77-97ac-11fa0c456c1f'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:47 user nova-compute[73029]: INFO os_vif [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc')
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:39:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No VIF found with MAC fa:16:3e:16:10:6b, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:39:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-dc47709d-50a8-4691-83b3-e4d73ace9cd3 req-9bc77331-c2f1-4fab-8fca-a559b0e7bc6a service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-dc47709d-50a8-4691-83b3-e4d73ace9cd3 req-9bc77331-c2f1-4fab-8fca-a559b0e7bc6a service nova] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-dc47709d-50a8-4691-83b3-e4d73ace9cd3 req-9bc77331-c2f1-4fab-8fca-a559b0e7bc6a service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-dc47709d-50a8-4691-83b3-e4d73ace9cd3 req-9bc77331-c2f1-4fab-8fca-a559b0e7bc6a service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-dc47709d-50a8-4691-83b3-e4d73ace9cd3 req-9bc77331-c2f1-4fab-8fca-a559b0e7bc6a service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] No waiting events found dispatching network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:49 user nova-compute[73029]: WARNING nova.compute.manager [req-dc47709d-50a8-4691-83b3-e4d73ace9cd3 req-9bc77331-c2f1-4fab-8fca-a559b0e7bc6a service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received unexpected event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d for instance with vm_state active and task_state rebuild_spawning.
Aug 10 00:39:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-0a13b50e-4418-4ada-80b5-9777322c0d60 req-ae1376ad-667d-429b-828b-748180709121 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:39:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0a13b50e-4418-4ada-80b5-9777322c0d60 req-ae1376ad-667d-429b-828b-748180709121 service nova] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0a13b50e-4418-4ada-80b5-9777322c0d60 req-ae1376ad-667d-429b-828b-748180709121 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0a13b50e-4418-4ada-80b5-9777322c0d60 req-ae1376ad-667d-429b-828b-748180709121 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-0a13b50e-4418-4ada-80b5-9777322c0d60 req-ae1376ad-667d-429b-828b-748180709121 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] No waiting events found dispatching network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:39:51 user nova-compute[73029]: WARNING nova.compute.manager [req-0a13b50e-4418-4ada-80b5-9777322c0d60 req-ae1376ad-667d-429b-828b-748180709121 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received unexpected event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d for instance with vm_state active and task_state rebuild_spawning.
Aug 10 00:39:51 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627991.9217305, ee3b2f60-0756-4d77-97ac-11fa0c456c1f => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:51 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] VM Resumed (Lifecycle Event)
Aug 10 00:39:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:39:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:39:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Instance spawned successfully.
Aug 10 00:39:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:39:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:39:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:52 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691627991.923527, ee3b2f60-0756-4d77-97ac-11fa0c456c1f => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:52 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] VM Started (Lifecycle Event)
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:39:52 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73029) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-de616079-c82d-4d51-8dbc-c0982234c549 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.094s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:39:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:54 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627979.0783303, dc191a1a-b684-4b2a-8cee-0572a6396b0d => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:54 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] VM Stopped (Lifecycle Event)
Aug 10 00:39:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-87cc4fe7-357c-402f-aed1-c2b1dba30e5a None None] [instance: dc191a1a-b684-4b2a-8cee-0572a6396b0d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:54 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691627979.5777335, f1561416-585d-4d7d-a1d7-86a64cf00630 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:39:54 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] VM Stopped (Lifecycle Event)
Aug 10 00:39:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0c3d8c1c-ce43-4881-8503-d54499cf2eea None None] [instance: f1561416-585d-4d7d-a1d7-86a64cf00630] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:39:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:39:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:39:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:39:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:39:59 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:39:59 user nova-compute[73029]: INFO nova.compute.claims [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Claim successful on node user
Aug 10 00:40:00 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.961s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG nova.network.neutron [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:40:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:40:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG nova.policy [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad2270c0a6174155935ad1ed13f26248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3ad2bae432474e92d1d111907f5fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:40:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Creating image(s)
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "/opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "/opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.155s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk 1073741824" returned: 0 in 0.065s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.164s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Cannot resize image /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG nova.objects.instance [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lazy-loading 'migration_context' on Instance uuid 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Ensure instance console log exists: /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG nova.network.neutron [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Successfully created port: 9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:40:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:02 user nova-compute[73029]: DEBUG nova.network.neutron [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Successfully updated port: 9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:40:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:40:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquired lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:40:02 user nova-compute[73029]: DEBUG nova.network.neutron [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:40:02 user nova-compute[73029]: DEBUG nova.compute.manager [req-96bd7284-1f53-4899-a4e2-c19f315fad15 req-7ce7d8ac-68eb-4a14-805b-3fa4a8fe96ca service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received event network-changed-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:02 user nova-compute[73029]: DEBUG nova.compute.manager [req-96bd7284-1f53-4899-a4e2-c19f315fad15 req-7ce7d8ac-68eb-4a14-805b-3fa4a8fe96ca service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Refreshing instance network info cache due to event network-changed-9dfbbab5-a67c-4672-b965-328591564d2c. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:40:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-96bd7284-1f53-4899-a4e2-c19f315fad15 req-7ce7d8ac-68eb-4a14-805b-3fa4a8fe96ca service nova] Acquiring lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:40:03 user nova-compute[73029]: INFO nova.compute.claims [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Claim successful on node user
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Updating instance_info_cache with network_info: [{"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Releasing lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Instance network_info: |[{"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-96bd7284-1f53-4899-a4e2-c19f315fad15 req-7ce7d8ac-68eb-4a14-805b-3fa4a8fe96ca service nova] Acquired lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.network.neutron [req-96bd7284-1f53-4899-a4e2-c19f315fad15 req-7ce7d8ac-68eb-4a14-805b-3fa4a8fe96ca service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Refreshing network info cache for port 9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Start _get_guest_xml network_info=[{"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:40:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1166444685',display_name='tempest-TestVolumeSwap-server-1166444685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1166444685',id=15,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQFWS1Hzo84fgtzfKF/HW0a7WWgdBymKCnZ0w/W1Tm6r9d+BTEXjrMoh6ZfEo+N2IdVluKF+xrNPqoL7F1iIxseAj98sZtwu+OJJkT6bZSFpZdhPLcU/STPB12SEPKeeQ==',key_name='tempest-keypair-630292605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa3ad2bae432474e92d1d111907f5fc4',ramdisk_id='',reservation_id='r-xt1cq3hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1189001466',owner_user_name='tempest-TestVolumeSwap-1189001466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad2270c0a6174155935ad1ed13f26248',uuid=5e356ed0-276c-4a27-9294-3176cc022c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Converting VIF {"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=9dfbbab5-a67c-4672-b965-328591564d2c,network=Network(518d382e-685c-48b4-a0a1-b645fcba9fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfbbab5-a6') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.objects.instance [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:40:03 user nova-compute[73029]:   <uuid>5e356ed0-276c-4a27-9294-3176cc022c18</uuid>
Aug 10 00:40:03 user nova-compute[73029]:   <name>instance-0000000f</name>
Aug 10 00:40:03 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:40:03 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:40:03 user nova-compute[73029]:   <metadata>
Aug 10 00:40:03 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:40:03 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:40:03 user nova-compute[73029]:       <nova:name>tempest-TestVolumeSwap-server-1166444685</nova:name>
Aug 10 00:40:03 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:40:03</nova:creationTime>
Aug 10 00:40:03 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:40:03 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:40:03 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:40:03 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:40:03 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:40:03 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:40:03 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:40:03 user nova-compute[73029]:       <nova:owner>
Aug 10 00:40:03 user nova-compute[73029]:         <nova:user uuid="ad2270c0a6174155935ad1ed13f26248">tempest-TestVolumeSwap-1189001466-project-member</nova:user>
Aug 10 00:40:03 user nova-compute[73029]:         <nova:project uuid="fa3ad2bae432474e92d1d111907f5fc4">tempest-TestVolumeSwap-1189001466</nova:project>
Aug 10 00:40:03 user nova-compute[73029]:       </nova:owner>
Aug 10 00:40:03 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:40:03 user nova-compute[73029]:       <nova:ports>
Aug 10 00:40:03 user nova-compute[73029]:         <nova:port uuid="9dfbbab5-a67c-4672-b965-328591564d2c">
Aug 10 00:40:03 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 10 00:40:03 user nova-compute[73029]:         </nova:port>
Aug 10 00:40:03 user nova-compute[73029]:       </nova:ports>
Aug 10 00:40:03 user nova-compute[73029]:     </nova:instance>
Aug 10 00:40:03 user nova-compute[73029]:   </metadata>
Aug 10 00:40:03 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:40:03 user nova-compute[73029]:     <system>
Aug 10 00:40:03 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:40:03 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:40:03 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:40:03 user nova-compute[73029]:       <entry name="serial">5e356ed0-276c-4a27-9294-3176cc022c18</entry>
Aug 10 00:40:03 user nova-compute[73029]:       <entry name="uuid">5e356ed0-276c-4a27-9294-3176cc022c18</entry>
Aug 10 00:40:03 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:40:03 user nova-compute[73029]:     </system>
Aug 10 00:40:03 user nova-compute[73029]:   </sysinfo>
Aug 10 00:40:03 user nova-compute[73029]:   <os>
Aug 10 00:40:03 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:40:03 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:40:03 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:40:03 user nova-compute[73029]:   </os>
Aug 10 00:40:03 user nova-compute[73029]:   <features>
Aug 10 00:40:03 user nova-compute[73029]:     <acpi/>
Aug 10 00:40:03 user nova-compute[73029]:     <apic/>
Aug 10 00:40:03 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:40:03 user nova-compute[73029]:   </features>
Aug 10 00:40:03 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:40:03 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:40:03 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:40:03 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:40:03 user nova-compute[73029]:   </clock>
Aug 10 00:40:03 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:40:03 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:40:03 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:40:03 user nova-compute[73029]:   </cpu>
Aug 10 00:40:03 user nova-compute[73029]:   <devices>
Aug 10 00:40:03 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:40:03 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:40:03 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk"/>
Aug 10 00:40:03 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:40:03 user nova-compute[73029]:     </disk>
Aug 10 00:40:03 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:40:03 user nova-compute[73029]:       <mac address="fa:16:3e:5a:28:f2"/>
Aug 10 00:40:03 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:40:03 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:40:03 user nova-compute[73029]:       <target dev="tap9dfbbab5-a6"/>
Aug 10 00:40:03 user nova-compute[73029]:     </interface>
Aug 10 00:40:03 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:40:03 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/console.log" append="off"/>
Aug 10 00:40:03 user nova-compute[73029]:     </serial>
Aug 10 00:40:03 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:40:03 user nova-compute[73029]:     <video>
Aug 10 00:40:03 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:40:03 user nova-compute[73029]:     </video>
Aug 10 00:40:03 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:40:03 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:40:03 user nova-compute[73029]:     </rng>
Aug 10 00:40:03 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:40:03 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:40:03 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:40:03 user nova-compute[73029]:     </memballoon>
Aug 10 00:40:03 user nova-compute[73029]:   </devices>
Aug 10 00:40:03 user nova-compute[73029]: </domain>
Aug 10 00:40:03 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1166444685',display_name='tempest-TestVolumeSwap-server-1166444685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1166444685',id=15,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQFWS1Hzo84fgtzfKF/HW0a7WWgdBymKCnZ0w/W1Tm6r9d+BTEXjrMoh6ZfEo+N2IdVluKF+xrNPqoL7F1iIxseAj98sZtwu+OJJkT6bZSFpZdhPLcU/STPB12SEPKeeQ==',key_name='tempest-keypair-630292605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa3ad2bae432474e92d1d111907f5fc4',ramdisk_id='',reservation_id='r-xt1cq3hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1189001466',owner_user_name='tempest-TestVolumeSwap-1189001466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad2270c0a6174155935ad1ed13f26248',uuid=5e356ed0-276c-4a27-9294-3176cc022c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Converting VIF {"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=9dfbbab5-a67c-4672-b965-328591564d2c,network=Network(518d382e-685c-48b4-a0a1-b645fcba9fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfbbab5-a6') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG os_vif [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=9dfbbab5-a67c-4672-b965-328591564d2c,network=Network(518d382e-685c-48b4-a0a1-b645fcba9fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfbbab5-a6') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dfbbab5-a6, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9dfbbab5-a6, col_values=(('external_ids', {'iface-id': '9dfbbab5-a67c-4672-b965-328591564d2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:28:f2', 'vm-uuid': '5e356ed0-276c-4a27-9294-3176cc022c18'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:03 user nova-compute[73029]: INFO os_vif [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=9dfbbab5-a67c-4672-b965-328591564d2c,network=Network(518d382e-685c-48b4-a0a1-b645fcba9fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfbbab5-a6')
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] No VIF found with MAC fa:16:3e:5a:28:f2, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:40:03 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:40:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:40:04 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Creating image(s)
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.policy [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a4fb6b058c64442b1688a3962849322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54d7ee7b2c741e2bbc4a1fb4a2cc042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.network.neutron [req-96bd7284-1f53-4899-a4e2-c19f315fad15 req-7ce7d8ac-68eb-4a14-805b-3fa4a8fe96ca service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Updated VIF entry in instance network info cache for port 9dfbbab5-a67c-4672-b965-328591564d2c. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.network.neutron [req-96bd7284-1f53-4899-a4e2-c19f315fad15 req-7ce7d8ac-68eb-4a14-805b-3fa4a8fe96ca service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Updating instance_info_cache with network_info: [{"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-96bd7284-1f53-4899-a4e2-c19f315fad15 req-7ce7d8ac-68eb-4a14-805b-3fa4a8fe96ca service nova] Releasing lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.172s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk 1073741824" returned: 0 in 0.063s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "34141f58-5c62-4245-bd2a-06d4e4518529" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.162s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:40:04 user nova-compute[73029]: INFO nova.compute.claims [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Claim successful on node user
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Cannot resize image /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.objects.instance [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'migration_context' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Ensure instance console log exists: /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG nova.network.neutron [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Successfully created port: 3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-f8ee8e93-7f44-4bd4-8b89-74b14cbe2154 req-991b3b55-5436-46fb-a571-e21eb0ed1133 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received event network-vif-plugged-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f8ee8e93-7f44-4bd4-8b89-74b14cbe2154 req-991b3b55-5436-46fb-a571-e21eb0ed1133 service nova] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f8ee8e93-7f44-4bd4-8b89-74b14cbe2154 req-991b3b55-5436-46fb-a571-e21eb0ed1133 service nova] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f8ee8e93-7f44-4bd4-8b89-74b14cbe2154 req-991b3b55-5436-46fb-a571-e21eb0ed1133 service nova] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-f8ee8e93-7f44-4bd4-8b89-74b14cbe2154 req-991b3b55-5436-46fb-a571-e21eb0ed1133 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] No waiting events found dispatching network-vif-plugged-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:05 user nova-compute[73029]: WARNING nova.compute.manager [req-f8ee8e93-7f44-4bd4-8b89-74b14cbe2154 req-991b3b55-5436-46fb-a571-e21eb0ed1133 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received unexpected event network-vif-plugged-9dfbbab5-a67c-4672-b965-328591564d2c for instance with vm_state building and task_state spawning.
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.network.neutron [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:40:05 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:40:05 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Creating image(s)
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.158s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG nova.policy [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a4fb6b058c64442b1688a3962849322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54d7ee7b2c741e2bbc4a1fb4a2cc042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.164s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk 1073741824" returned: 0 in 0.061s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Cannot resize image /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.objects.instance [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'migration_context' on Instance uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Ensure instance console log exists: /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.network.neutron [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Successfully updated port: 3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquired lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.network.neutron [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-092c50fc-8ea3-4bea-a077-7cff7269cd3e req-d4a84be4-2f48-49e4-897e-ff14af32ee1c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-changed-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-092c50fc-8ea3-4bea-a077-7cff7269cd3e req-d4a84be4-2f48-49e4-897e-ff14af32ee1c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Refreshing instance network info cache due to event network-changed-3eb034f0-40de-4c90-aaa8-5a9afdf3461c. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-092c50fc-8ea3-4bea-a077-7cff7269cd3e req-d4a84be4-2f48-49e4-897e-ff14af32ee1c service nova] Acquiring lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.network.neutron [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Successfully created port: e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG nova.network.neutron [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:40:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.network.neutron [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updating instance_info_cache with network_info: [{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.compute.manager [req-a0e80c86-4e79-451b-a57d-1b1f74626fac req-78790ac9-98bc-4a06-b6d3-29ee47433724 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received event network-vif-plugged-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a0e80c86-4e79-451b-a57d-1b1f74626fac req-78790ac9-98bc-4a06-b6d3-29ee47433724 service nova] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a0e80c86-4e79-451b-a57d-1b1f74626fac req-78790ac9-98bc-4a06-b6d3-29ee47433724 service nova] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a0e80c86-4e79-451b-a57d-1b1f74626fac req-78790ac9-98bc-4a06-b6d3-29ee47433724 service nova] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.compute.manager [req-a0e80c86-4e79-451b-a57d-1b1f74626fac req-78790ac9-98bc-4a06-b6d3-29ee47433724 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] No waiting events found dispatching network-vif-plugged-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:07 user nova-compute[73029]: WARNING nova.compute.manager [req-a0e80c86-4e79-451b-a57d-1b1f74626fac req-78790ac9-98bc-4a06-b6d3-29ee47433724 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received unexpected event network-vif-plugged-9dfbbab5-a67c-4672-b965-328591564d2c for instance with vm_state building and task_state spawning.
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628007.190655, 5e356ed0-276c-4a27-9294-3176cc022c18 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:40:07 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] VM Resumed (Lifecycle Event)
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Releasing lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Instance network_info: |[{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-092c50fc-8ea3-4bea-a077-7cff7269cd3e req-d4a84be4-2f48-49e4-897e-ff14af32ee1c service nova] Acquired lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.network.neutron [req-092c50fc-8ea3-4bea-a077-7cff7269cd3e req-d4a84be4-2f48-49e4-897e-ff14af32ee1c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Refreshing network info cache for port 3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Start _get_guest_xml network_info=[{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:40:07 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Instance spawned successfully.
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:40:07 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:07 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:40:07 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628007.1955888, 5e356ed0-276c-4a27-9294-3176cc022c18 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:40:07 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] VM Started (Lifecycle Event)
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-405003104',display_name='tempest-ServerRescueNegativeTestJSON-server-405003104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-405003104',id=16,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-9awclp1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:04Z,user_data=None,user_id='4a4fb6b058c64442b1688a3962849322',uuid=a2f85a2f-0bb4-4020-9260-98f866f5c9f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:61:2e,bridge_name='br-int',has_traffic_filtering=True,id=3eb034f0-40de-4c90-aaa8-5a9afdf3461c,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb034f0-40') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.objects.instance [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'pci_devices' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:40:07 user nova-compute[73029]:   <uuid>a2f85a2f-0bb4-4020-9260-98f866f5c9f6</uuid>
Aug 10 00:40:07 user nova-compute[73029]:   <name>instance-00000010</name>
Aug 10 00:40:07 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:40:07 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:40:07 user nova-compute[73029]:   <metadata>
Aug 10 00:40:07 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:40:07 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:40:07 user nova-compute[73029]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-405003104</nova:name>
Aug 10 00:40:07 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:40:07</nova:creationTime>
Aug 10 00:40:07 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:40:07 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:40:07 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:40:07 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:40:07 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:40:07 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:40:07 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:40:07 user nova-compute[73029]:       <nova:owner>
Aug 10 00:40:07 user nova-compute[73029]:         <nova:user uuid="4a4fb6b058c64442b1688a3962849322">tempest-ServerRescueNegativeTestJSON-1160585559-project-member</nova:user>
Aug 10 00:40:07 user nova-compute[73029]:         <nova:project uuid="e54d7ee7b2c741e2bbc4a1fb4a2cc042">tempest-ServerRescueNegativeTestJSON-1160585559</nova:project>
Aug 10 00:40:07 user nova-compute[73029]:       </nova:owner>
Aug 10 00:40:07 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:40:07 user nova-compute[73029]:       <nova:ports>
Aug 10 00:40:07 user nova-compute[73029]:         <nova:port uuid="3eb034f0-40de-4c90-aaa8-5a9afdf3461c">
Aug 10 00:40:07 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 10 00:40:07 user nova-compute[73029]:         </nova:port>
Aug 10 00:40:07 user nova-compute[73029]:       </nova:ports>
Aug 10 00:40:07 user nova-compute[73029]:     </nova:instance>
Aug 10 00:40:07 user nova-compute[73029]:   </metadata>
Aug 10 00:40:07 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:40:07 user nova-compute[73029]:     <system>
Aug 10 00:40:07 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:40:07 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:40:07 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:40:07 user nova-compute[73029]:       <entry name="serial">a2f85a2f-0bb4-4020-9260-98f866f5c9f6</entry>
Aug 10 00:40:07 user nova-compute[73029]:       <entry name="uuid">a2f85a2f-0bb4-4020-9260-98f866f5c9f6</entry>
Aug 10 00:40:07 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:40:07 user nova-compute[73029]:     </system>
Aug 10 00:40:07 user nova-compute[73029]:   </sysinfo>
Aug 10 00:40:07 user nova-compute[73029]:   <os>
Aug 10 00:40:07 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:40:07 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:40:07 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:40:07 user nova-compute[73029]:   </os>
Aug 10 00:40:07 user nova-compute[73029]:   <features>
Aug 10 00:40:07 user nova-compute[73029]:     <acpi/>
Aug 10 00:40:07 user nova-compute[73029]:     <apic/>
Aug 10 00:40:07 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:40:07 user nova-compute[73029]:   </features>
Aug 10 00:40:07 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:40:07 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:40:07 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:40:07 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:40:07 user nova-compute[73029]:   </clock>
Aug 10 00:40:07 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:40:07 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:40:07 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:40:07 user nova-compute[73029]:   </cpu>
Aug 10 00:40:07 user nova-compute[73029]:   <devices>
Aug 10 00:40:07 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:40:07 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:40:07 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk"/>
Aug 10 00:40:07 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:40:07 user nova-compute[73029]:     </disk>
Aug 10 00:40:07 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:40:07 user nova-compute[73029]:       <mac address="fa:16:3e:be:61:2e"/>
Aug 10 00:40:07 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:40:07 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:40:07 user nova-compute[73029]:       <target dev="tap3eb034f0-40"/>
Aug 10 00:40:07 user nova-compute[73029]:     </interface>
Aug 10 00:40:07 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:40:07 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/console.log" append="off"/>
Aug 10 00:40:07 user nova-compute[73029]:     </serial>
Aug 10 00:40:07 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:40:07 user nova-compute[73029]:     <video>
Aug 10 00:40:07 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:40:07 user nova-compute[73029]:     </video>
Aug 10 00:40:07 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:40:07 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:40:07 user nova-compute[73029]:     </rng>
Aug 10 00:40:07 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:40:07 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:40:07 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:40:07 user nova-compute[73029]:     </memballoon>
Aug 10 00:40:07 user nova-compute[73029]:   </devices>
Aug 10 00:40:07 user nova-compute[73029]: </domain>
Aug 10 00:40:07 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-405003104',display_name='tempest-ServerRescueNegativeTestJSON-server-405003104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-405003104',id=16,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-9awclp1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:04Z,user_data=None,user_id='4a4fb6b058c64442b1688a3962849322',uuid=a2f85a2f-0bb4-4020-9260-98f866f5c9f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:61:2e,bridge_name='br-int',has_traffic_filtering=True,id=3eb034f0-40de-4c90-aaa8-5a9afdf3461c,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb034f0-40') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG os_vif [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:61:2e,bridge_name='br-int',has_traffic_filtering=True,id=3eb034f0-40de-4c90-aaa8-5a9afdf3461c,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb034f0-40') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eb034f0-40, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3eb034f0-40, col_values=(('external_ids', {'iface-id': '3eb034f0-40de-4c90-aaa8-5a9afdf3461c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:61:2e', 'vm-uuid': 'a2f85a2f-0bb4-4020-9260-98f866f5c9f6'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:40:07 user nova-compute[73029]: INFO nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Took 6.92 seconds to spawn the instance on the hypervisor.
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:07 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:40:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:07 user nova-compute[73029]: INFO os_vif [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:61:2e,bridge_name='br-int',has_traffic_filtering=True,id=3eb034f0-40de-4c90-aaa8-5a9afdf3461c,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb034f0-40')
Aug 10 00:40:07 user nova-compute[73029]: INFO nova.compute.manager [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Took 8.29 seconds to build instance.
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No VIF found with MAC fa:16:3e:be:61:2e, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-27f2a158-5faa-47a2-bdd5-4403d4ab081d tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.444s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.network.neutron [req-092c50fc-8ea3-4bea-a077-7cff7269cd3e req-d4a84be4-2f48-49e4-897e-ff14af32ee1c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updated VIF entry in instance network info cache for port 3eb034f0-40de-4c90-aaa8-5a9afdf3461c. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG nova.network.neutron [req-092c50fc-8ea3-4bea-a077-7cff7269cd3e req-d4a84be4-2f48-49e4-897e-ff14af32ee1c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updating instance_info_cache with network_info: [{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-092c50fc-8ea3-4bea-a077-7cff7269cd3e req-d4a84be4-2f48-49e4-897e-ff14af32ee1c service nova] Releasing lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.network.neutron [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Successfully updated port: e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquired lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.network.neutron [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.network.neutron [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-5a7475d3-ddb3-4022-a837-32bd350d5b4f req-58501c2e-ec69-4443-8ccb-e991f5626a3b service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-changed-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-5a7475d3-ddb3-4022-a837-32bd350d5b4f req-58501c2e-ec69-4443-8ccb-e991f5626a3b service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Refreshing instance network info cache due to event network-changed-e5a3d05c-7b55-4c15-9928-da308650b378. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5a7475d3-ddb3-4022-a837-32bd350d5b4f req-58501c2e-ec69-4443-8ccb-e991f5626a3b service nova] Acquiring lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.network.neutron [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updating instance_info_cache with network_info: [{"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Releasing lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Instance network_info: |[{"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5a7475d3-ddb3-4022-a837-32bd350d5b4f req-58501c2e-ec69-4443-8ccb-e991f5626a3b service nova] Acquired lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.network.neutron [req-5a7475d3-ddb3-4022-a837-32bd350d5b4f req-58501c2e-ec69-4443-8ccb-e991f5626a3b service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Refreshing network info cache for port e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Start _get_guest_xml network_info=[{"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:08 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:08 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1615132056',display_name='tempest-ServerRescueNegativeTestJSON-server-1615132056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1615132056',id=17,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-tjlw8zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:05Z,user_data=None,user_id='4a4fb6b058c64442b1688a3962849322',uuid=34141f58-5c62-4245-bd2a-06d4e4518529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e5a3d05c-7b55-4c15-9928-da308650b378,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a3d05c-7b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'pci_devices' on Instance uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:40:08 user nova-compute[73029]:   <uuid>34141f58-5c62-4245-bd2a-06d4e4518529</uuid>
Aug 10 00:40:08 user nova-compute[73029]:   <name>instance-00000011</name>
Aug 10 00:40:08 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:40:08 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:40:08 user nova-compute[73029]:   <metadata>
Aug 10 00:40:08 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:40:08 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:40:08 user nova-compute[73029]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1615132056</nova:name>
Aug 10 00:40:08 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:40:08</nova:creationTime>
Aug 10 00:40:08 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:40:08 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:40:08 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:40:08 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:40:08 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:40:08 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:40:08 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:40:08 user nova-compute[73029]:       <nova:owner>
Aug 10 00:40:08 user nova-compute[73029]:         <nova:user uuid="4a4fb6b058c64442b1688a3962849322">tempest-ServerRescueNegativeTestJSON-1160585559-project-member</nova:user>
Aug 10 00:40:08 user nova-compute[73029]:         <nova:project uuid="e54d7ee7b2c741e2bbc4a1fb4a2cc042">tempest-ServerRescueNegativeTestJSON-1160585559</nova:project>
Aug 10 00:40:08 user nova-compute[73029]:       </nova:owner>
Aug 10 00:40:08 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:40:08 user nova-compute[73029]:       <nova:ports>
Aug 10 00:40:08 user nova-compute[73029]:         <nova:port uuid="e5a3d05c-7b55-4c15-9928-da308650b378">
Aug 10 00:40:08 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 10 00:40:08 user nova-compute[73029]:         </nova:port>
Aug 10 00:40:08 user nova-compute[73029]:       </nova:ports>
Aug 10 00:40:08 user nova-compute[73029]:     </nova:instance>
Aug 10 00:40:08 user nova-compute[73029]:   </metadata>
Aug 10 00:40:08 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:40:08 user nova-compute[73029]:     <system>
Aug 10 00:40:08 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:40:08 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:40:08 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:40:08 user nova-compute[73029]:       <entry name="serial">34141f58-5c62-4245-bd2a-06d4e4518529</entry>
Aug 10 00:40:08 user nova-compute[73029]:       <entry name="uuid">34141f58-5c62-4245-bd2a-06d4e4518529</entry>
Aug 10 00:40:08 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:40:08 user nova-compute[73029]:     </system>
Aug 10 00:40:08 user nova-compute[73029]:   </sysinfo>
Aug 10 00:40:08 user nova-compute[73029]:   <os>
Aug 10 00:40:08 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:40:08 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:40:08 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:40:08 user nova-compute[73029]:   </os>
Aug 10 00:40:08 user nova-compute[73029]:   <features>
Aug 10 00:40:08 user nova-compute[73029]:     <acpi/>
Aug 10 00:40:08 user nova-compute[73029]:     <apic/>
Aug 10 00:40:08 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:40:08 user nova-compute[73029]:   </features>
Aug 10 00:40:08 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:40:08 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:40:08 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:40:08 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:40:08 user nova-compute[73029]:   </clock>
Aug 10 00:40:08 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:40:08 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:40:08 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:40:08 user nova-compute[73029]:   </cpu>
Aug 10 00:40:08 user nova-compute[73029]:   <devices>
Aug 10 00:40:08 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:40:08 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:40:08 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk"/>
Aug 10 00:40:08 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:40:08 user nova-compute[73029]:     </disk>
Aug 10 00:40:08 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:40:08 user nova-compute[73029]:       <mac address="fa:16:3e:ed:48:80"/>
Aug 10 00:40:08 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:40:08 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:40:08 user nova-compute[73029]:       <target dev="tape5a3d05c-7b"/>
Aug 10 00:40:08 user nova-compute[73029]:     </interface>
Aug 10 00:40:08 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:40:08 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/console.log" append="off"/>
Aug 10 00:40:08 user nova-compute[73029]:     </serial>
Aug 10 00:40:08 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:40:08 user nova-compute[73029]:     <video>
Aug 10 00:40:08 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:40:08 user nova-compute[73029]:     </video>
Aug 10 00:40:08 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:40:08 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:40:08 user nova-compute[73029]:     </rng>
Aug 10 00:40:08 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:40:08 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:40:08 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:40:08 user nova-compute[73029]:     </memballoon>
Aug 10 00:40:08 user nova-compute[73029]:   </devices>
Aug 10 00:40:08 user nova-compute[73029]: </domain>
Aug 10 00:40:08 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1615132056',display_name='tempest-ServerRescueNegativeTestJSON-server-1615132056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1615132056',id=17,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-tjlw8zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:05Z,user_data=None,user_id='4a4fb6b058c64442b1688a3962849322',uuid=34141f58-5c62-4245-bd2a-06d4e4518529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e5a3d05c-7b55-4c15-9928-da308650b378,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a3d05c-7b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG os_vif [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e5a3d05c-7b55-4c15-9928-da308650b378,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a3d05c-7b') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5a3d05c-7b, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5a3d05c-7b, col_values=(('external_ids', {'iface-id': 'e5a3d05c-7b55-4c15-9928-da308650b378', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:48:80', 'vm-uuid': '34141f58-5c62-4245-bd2a-06d4e4518529'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:08 user nova-compute[73029]: INFO os_vif [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e5a3d05c-7b55-4c15-9928-da308650b378,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a3d05c-7b')
Aug 10 00:40:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:40:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No VIF found with MAC fa:16:3e:ed:48:80, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:40:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG nova.network.neutron [req-5a7475d3-ddb3-4022-a837-32bd350d5b4f req-58501c2e-ec69-4443-8ccb-e991f5626a3b service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updated VIF entry in instance network info cache for port e5a3d05c-7b55-4c15-9928-da308650b378. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG nova.network.neutron [req-5a7475d3-ddb3-4022-a837-32bd350d5b4f req-58501c2e-ec69-4443-8ccb-e991f5626a3b service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updating instance_info_cache with network_info: [{"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5a7475d3-ddb3-4022-a837-32bd350d5b4f req-58501c2e-ec69-4443-8ccb-e991f5626a3b service nova] Releasing lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:10 user nova-compute[73029]: WARNING nova.compute.manager [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state building and task_state spawning.
Aug 10 00:40:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:10 user nova-compute[73029]: WARNING nova.compute.manager [req-6f18a301-128e-4467-8a50-efcb123b7dc0 req-f11426ed-2346-4cf5-a23b-79d3585f229c service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state building and task_state spawning.
Aug 10 00:40:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11eb62f-78f6-4528-9706-f092f63dc273 req-8a7e7812-81cc-4a3d-b242-709f900d7adb service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11eb62f-78f6-4528-9706-f092f63dc273 req-8a7e7812-81cc-4a3d-b242-709f900d7adb service nova] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11eb62f-78f6-4528-9706-f092f63dc273 req-8a7e7812-81cc-4a3d-b242-709f900d7adb service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f11eb62f-78f6-4528-9706-f092f63dc273 req-8a7e7812-81cc-4a3d-b242-709f900d7adb service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-f11eb62f-78f6-4528-9706-f092f63dc273 req-8a7e7812-81cc-4a3d-b242-709f900d7adb service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] No waiting events found dispatching network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:10 user nova-compute[73029]: WARNING nova.compute.manager [req-f11eb62f-78f6-4528-9706-f092f63dc273 req-8a7e7812-81cc-4a3d-b242-709f900d7adb service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received unexpected event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 for instance with vm_state building and task_state spawning.
Aug 10 00:40:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628012.354663, a2f85a2f-0bb4-4020-9260-98f866f5c9f6 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] VM Resumed (Lifecycle Event)
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Instance spawned successfully.
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628012.3594015, a2f85a2f-0bb4-4020-9260-98f866f5c9f6 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] VM Started (Lifecycle Event)
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Took 8.50 seconds to spawn the instance on the hypervisor.
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.compute.manager [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Took 9.35 seconds to build instance.
Aug 10 00:40:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-acc6b3a3-2324-4a3d-abaf-674c9ee5dee7 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.482s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628012.9057727, 34141f58-5c62-4245-bd2a-06d4e4518529 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] VM Resumed (Lifecycle Event)
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Instance spawned successfully.
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628012.9072583, 34141f58-5c62-4245-bd2a-06d4e4518529 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:40:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] VM Started (Lifecycle Event)
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:40:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-e8973960-76a6-41b4-92e9-468946e8e82a req-c8546232-485b-426d-8a8a-2f86c2d1bb36 service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e8973960-76a6-41b4-92e9-468946e8e82a req-c8546232-485b-426d-8a8a-2f86c2d1bb36 service nova] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e8973960-76a6-41b4-92e9-468946e8e82a req-c8546232-485b-426d-8a8a-2f86c2d1bb36 service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e8973960-76a6-41b4-92e9-468946e8e82a req-c8546232-485b-426d-8a8a-2f86c2d1bb36 service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-e8973960-76a6-41b4-92e9-468946e8e82a req-c8546232-485b-426d-8a8a-2f86c2d1bb36 service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] No waiting events found dispatching network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:13 user nova-compute[73029]: WARNING nova.compute.manager [req-e8973960-76a6-41b4-92e9-468946e8e82a req-c8546232-485b-426d-8a8a-2f86c2d1bb36 service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received unexpected event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 for instance with vm_state building and task_state spawning.
Aug 10 00:40:13 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:40:13 user nova-compute[73029]: INFO nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Took 7.64 seconds to spawn the instance on the hypervisor.
Aug 10 00:40:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:13 user nova-compute[73029]: INFO nova.compute.manager [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Took 8.61 seconds to build instance.
Aug 10 00:40:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-655b873c-0206-4392-b2a1-e2f284ae7da6 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "34141f58-5c62-4245-bd2a-06d4e4518529" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.772s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:40:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:40:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:40:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:40:15 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:40:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updating instance_info_cache with network_info: [{"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-e7d1898b-0b2e-4feb-9d06-48e20eb9e409" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7624MB free_disk=25.390357971191406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 2256b7fd-3705-438c-86d0-06dd355b4347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 5e356ed0-276c-4a27-9294-3176cc022c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:40:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:22 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:40:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:40:22 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:40:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:40:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:40:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:40:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "60e35a85-9268-4619-991d-05598abc314d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "60e35a85-9268-4619-991d-05598abc314d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:40:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:30 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:40:30 user nova-compute[73029]: INFO nova.compute.claims [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Claim successful on node user
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:31 user nova-compute[73029]: INFO nova.compute.manager [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Detaching volume 7d7b49d9-01cd-4e20-8ec5-05fafa9c0609
Aug 10 00:40:31 user nova-compute[73029]: INFO nova.virt.block_device [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Attempting to driver detach volume 7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 from mountpoint /dev/vdb
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Attempting to detach device vdb from instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:40:31 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:40:31 user nova-compute[73029]:   <source dev="/dev/sdh"/>
Aug 10 00:40:31 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:40:31 user nova-compute[73029]:   <serial>7d7b49d9-01cd-4e20-8ec5-05fafa9c0609</serial>
Aug 10 00:40:31 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:40:31 user nova-compute[73029]: </disk>
Aug 10 00:40:31 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:40:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully detached device vdb from instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 from the persistent domain config.
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:40:31 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:40:31 user nova-compute[73029]:   <source dev="/dev/sdh"/>
Aug 10 00:40:31 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:40:31 user nova-compute[73029]:   <serial>7d7b49d9-01cd-4e20-8ec5-05fafa9c0609</serial>
Aug 10 00:40:31 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:40:31 user nova-compute[73029]: </disk>
Aug 10 00:40:31 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.network.neutron [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:40:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.policy [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c16b4b3e2e34e5e9e53dcfaf4b948dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db8d6b005e844e3b1232942bf67fb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:40:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Creating image(s)
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "/opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "/opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "/opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628031.9394205, aa5be433-9c8a-4e52-b61d-15a84f188cc3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:40:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully detached device vdb from instance aa5be433-9c8a-4e52-b61d-15a84f188cc3 from the live domain config.
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.173s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSKZmJde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:40:32 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b097d6b8-25e3-4b75-be76-425678161c3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42ce6b3-4ed8-4e0a-badd-6034e62b24dd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:40:32 user nova-compute[73029]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:40:32 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:40:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:40:32 user nova-compute[73029]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:40:32 user nova-compute[73029]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 (non-flash)
Aug 10 00:40:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f0713b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609'): ({'sdh'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Removing single pathed devices sdh {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d585cf5-c9e4-4f70-bdaa-1b0449afced6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a4000-75dd-49e8-8ee4-336e73fd02fd]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flushing IO for device /dev/sdh {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk 1073741824" returned: 0 in 0.052s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b863b495-4c8b-490b-955b-f9fe2fbd4141]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c41144-7fbd-4f70-93aa-24317b046865]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] SCSI volumes sdh have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3c21e7-3bb0-42b7-a329-e50fe5b09f53]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.169s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a78dd0-3071-4b61-93cf-dc9efc6ec357]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609, portal: 172.16.0.220,3260]
Aug 10 00:40:32 user nova-compute[73029]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609, portal: 172.16.0.220,3260] successful.
Aug 10 00:40:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7b49d9-01cd-4e20-8ec5-05fafa9c0609 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e168c9d-b18e-41dd-8836-d7c38e46adb4]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] <== disconnect_volume: return (410ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Cannot resize image /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG nova.objects.instance [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lazy-loading 'migration_context' on Instance uuid 60e35a85-9268-4619-991d-05598abc314d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Ensure instance console log exists: /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.006s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:32 user nova-compute[73029]: DEBUG nova.network.neutron [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Successfully created port: e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG nova.objects.instance [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'flavor' on Instance uuid aa5be433-9c8a-4e52-b61d-15a84f188cc3 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7378a143-63df-49fd-b2d8-fa71809a207f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.179s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Successfully updated port: e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "refresh_cache-60e35a85-9268-4619-991d-05598abc314d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquired lock "refresh_cache-60e35a85-9268-4619-991d-05598abc314d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-933b0ae2-a02d-44c2-b5df-b071d7c32058 req-b170e90b-4446-49f0-b816-662a0b8cd870 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received event network-changed-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-933b0ae2-a02d-44c2-b5df-b071d7c32058 req-b170e90b-4446-49f0-b816-662a0b8cd870 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Refreshing instance network info cache due to event network-changed-e1b494a1-efb5-4c93-8631-67cf16d4c9d5. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-933b0ae2-a02d-44c2-b5df-b071d7c32058 req-b170e90b-4446-49f0-b816-662a0b8cd870 service nova] Acquiring lock "refresh_cache-60e35a85-9268-4619-991d-05598abc314d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:40:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Updating instance_info_cache with network_info: [{"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Releasing lock "refresh_cache-60e35a85-9268-4619-991d-05598abc314d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Instance network_info: |[{"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-933b0ae2-a02d-44c2-b5df-b071d7c32058 req-b170e90b-4446-49f0-b816-662a0b8cd870 service nova] Acquired lock "refresh_cache-60e35a85-9268-4619-991d-05598abc314d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-933b0ae2-a02d-44c2-b5df-b071d7c32058 req-b170e90b-4446-49f0-b816-662a0b8cd870 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Refreshing network info cache for port e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Start _get_guest_xml network_info=[{"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:40:34 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:34 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-131635809',display_name='tempest-VolumesActionsTest-instance-131635809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-131635809',id=18,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8d6b005e844e3b1232942bf67fb9a',ramdisk_id='',reservation_id='r-013v6zj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-261338927',owner_user_name='tempest-VolumesActionsTest-261338927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:32Z,user_data=None,user_id='9c16b4b3e2e34e5e9e53dcfaf4b948dd',uuid=60e35a85-9268-4619-991d-05598abc314d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converting VIF {"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=e1b494a1-efb5-4c93-8631-67cf16d4c9d5,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b494a1-ef') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lazy-loading 'pci_devices' on Instance uuid 60e35a85-9268-4619-991d-05598abc314d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:40:34 user nova-compute[73029]:   <uuid>60e35a85-9268-4619-991d-05598abc314d</uuid>
Aug 10 00:40:34 user nova-compute[73029]:   <name>instance-00000012</name>
Aug 10 00:40:34 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:40:34 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:40:34 user nova-compute[73029]:   <metadata>
Aug 10 00:40:34 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:40:34 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:40:34 user nova-compute[73029]:       <nova:name>tempest-VolumesActionsTest-instance-131635809</nova:name>
Aug 10 00:40:34 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:40:34</nova:creationTime>
Aug 10 00:40:34 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:40:34 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:40:34 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:40:34 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:40:34 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:40:34 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:40:34 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:40:34 user nova-compute[73029]:       <nova:owner>
Aug 10 00:40:34 user nova-compute[73029]:         <nova:user uuid="9c16b4b3e2e34e5e9e53dcfaf4b948dd">tempest-VolumesActionsTest-261338927-project-member</nova:user>
Aug 10 00:40:34 user nova-compute[73029]:         <nova:project uuid="4db8d6b005e844e3b1232942bf67fb9a">tempest-VolumesActionsTest-261338927</nova:project>
Aug 10 00:40:34 user nova-compute[73029]:       </nova:owner>
Aug 10 00:40:34 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:40:34 user nova-compute[73029]:       <nova:ports>
Aug 10 00:40:34 user nova-compute[73029]:         <nova:port uuid="e1b494a1-efb5-4c93-8631-67cf16d4c9d5">
Aug 10 00:40:34 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 10 00:40:34 user nova-compute[73029]:         </nova:port>
Aug 10 00:40:34 user nova-compute[73029]:       </nova:ports>
Aug 10 00:40:34 user nova-compute[73029]:     </nova:instance>
Aug 10 00:40:34 user nova-compute[73029]:   </metadata>
Aug 10 00:40:34 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:40:34 user nova-compute[73029]:     <system>
Aug 10 00:40:34 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:40:34 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:40:34 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:40:34 user nova-compute[73029]:       <entry name="serial">60e35a85-9268-4619-991d-05598abc314d</entry>
Aug 10 00:40:34 user nova-compute[73029]:       <entry name="uuid">60e35a85-9268-4619-991d-05598abc314d</entry>
Aug 10 00:40:34 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:40:34 user nova-compute[73029]:     </system>
Aug 10 00:40:34 user nova-compute[73029]:   </sysinfo>
Aug 10 00:40:34 user nova-compute[73029]:   <os>
Aug 10 00:40:34 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:40:34 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:40:34 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:40:34 user nova-compute[73029]:   </os>
Aug 10 00:40:34 user nova-compute[73029]:   <features>
Aug 10 00:40:34 user nova-compute[73029]:     <acpi/>
Aug 10 00:40:34 user nova-compute[73029]:     <apic/>
Aug 10 00:40:34 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:40:34 user nova-compute[73029]:   </features>
Aug 10 00:40:34 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:40:34 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:40:34 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:40:34 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:40:34 user nova-compute[73029]:   </clock>
Aug 10 00:40:34 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:40:34 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:40:34 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:40:34 user nova-compute[73029]:   </cpu>
Aug 10 00:40:34 user nova-compute[73029]:   <devices>
Aug 10 00:40:34 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:40:34 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:40:34 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk"/>
Aug 10 00:40:34 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:40:34 user nova-compute[73029]:     </disk>
Aug 10 00:40:34 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:40:34 user nova-compute[73029]:       <mac address="fa:16:3e:89:6d:19"/>
Aug 10 00:40:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:40:34 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:40:34 user nova-compute[73029]:       <target dev="tape1b494a1-ef"/>
Aug 10 00:40:34 user nova-compute[73029]:     </interface>
Aug 10 00:40:34 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:40:34 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/console.log" append="off"/>
Aug 10 00:40:34 user nova-compute[73029]:     </serial>
Aug 10 00:40:34 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:40:34 user nova-compute[73029]:     <video>
Aug 10 00:40:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:40:34 user nova-compute[73029]:     </video>
Aug 10 00:40:34 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:40:34 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:40:34 user nova-compute[73029]:     </rng>
Aug 10 00:40:34 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:40:34 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:40:34 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:40:34 user nova-compute[73029]:     </memballoon>
Aug 10 00:40:34 user nova-compute[73029]:   </devices>
Aug 10 00:40:34 user nova-compute[73029]: </domain>
Aug 10 00:40:34 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-131635809',display_name='tempest-VolumesActionsTest-instance-131635809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-131635809',id=18,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8d6b005e844e3b1232942bf67fb9a',ramdisk_id='',reservation_id='r-013v6zj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-261338927',owner_user_name='tempest-VolumesActionsTest-261338927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:32Z,user_data=None,user_id='9c16b4b3e2e34e5e9e53dcfaf4b948dd',uuid=60e35a85-9268-4619-991d-05598abc314d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converting VIF {"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=e1b494a1-efb5-4c93-8631-67cf16d4c9d5,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b494a1-ef') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG os_vif [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=e1b494a1-efb5-4c93-8631-67cf16d4c9d5,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b494a1-ef') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1b494a1-ef, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1b494a1-ef, col_values=(('external_ids', {'iface-id': 'e1b494a1-efb5-4c93-8631-67cf16d4c9d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:6d:19', 'vm-uuid': '60e35a85-9268-4619-991d-05598abc314d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:34 user nova-compute[73029]: INFO os_vif [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=e1b494a1-efb5-4c93-8631-67cf16d4c9d5,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b494a1-ef')
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] No VIF found with MAC fa:16:3e:89:6d:19, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-933b0ae2-a02d-44c2-b5df-b071d7c32058 req-b170e90b-4446-49f0-b816-662a0b8cd870 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Updated VIF entry in instance network info cache for port e1b494a1-efb5-4c93-8631-67cf16d4c9d5. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-933b0ae2-a02d-44c2-b5df-b071d7c32058 req-b170e90b-4446-49f0-b816-662a0b8cd870 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Updating instance_info_cache with network_info: [{"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-933b0ae2-a02d-44c2-b5df-b071d7c32058 req-b170e90b-4446-49f0-b816-662a0b8cd870 service nova] Releasing lock "refresh_cache-60e35a85-9268-4619-991d-05598abc314d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:40:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-63f282e2-126f-43e1-b3dc-6c73fc22c59e req-35d921dc-7eba-43ec-a8f6-a1a0956c9355 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received event network-vif-plugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-63f282e2-126f-43e1-b3dc-6c73fc22c59e req-35d921dc-7eba-43ec-a8f6-a1a0956c9355 service nova] Acquiring lock "60e35a85-9268-4619-991d-05598abc314d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-63f282e2-126f-43e1-b3dc-6c73fc22c59e req-35d921dc-7eba-43ec-a8f6-a1a0956c9355 service nova] Lock "60e35a85-9268-4619-991d-05598abc314d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-63f282e2-126f-43e1-b3dc-6c73fc22c59e req-35d921dc-7eba-43ec-a8f6-a1a0956c9355 service nova] Lock "60e35a85-9268-4619-991d-05598abc314d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-63f282e2-126f-43e1-b3dc-6c73fc22c59e req-35d921dc-7eba-43ec-a8f6-a1a0956c9355 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] No waiting events found dispatching network-vif-plugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:36 user nova-compute[73029]: WARNING nova.compute.manager [req-63f282e2-126f-43e1-b3dc-6c73fc22c59e req-35d921dc-7eba-43ec-a8f6-a1a0956c9355 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received unexpected event network-vif-plugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 for instance with vm_state building and task_state spawning.
Aug 10 00:40:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628038.3830707, 60e35a85-9268-4619-991d-05598abc314d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:40:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 60e35a85-9268-4619-991d-05598abc314d] VM Resumed (Lifecycle Event)
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:40:38 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 60e35a85-9268-4619-991d-05598abc314d] Instance spawned successfully.
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 60e35a85-9268-4619-991d-05598abc314d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-a2f29421-61e7-406f-a011-4612699af2c1 req-cd610aca-7213-4dee-a9dc-087c06118cd6 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received event network-vif-plugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a2f29421-61e7-406f-a011-4612699af2c1 req-cd610aca-7213-4dee-a9dc-087c06118cd6 service nova] Acquiring lock "60e35a85-9268-4619-991d-05598abc314d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a2f29421-61e7-406f-a011-4612699af2c1 req-cd610aca-7213-4dee-a9dc-087c06118cd6 service nova] Lock "60e35a85-9268-4619-991d-05598abc314d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a2f29421-61e7-406f-a011-4612699af2c1 req-cd610aca-7213-4dee-a9dc-087c06118cd6 service nova] Lock "60e35a85-9268-4619-991d-05598abc314d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-a2f29421-61e7-406f-a011-4612699af2c1 req-cd610aca-7213-4dee-a9dc-087c06118cd6 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] No waiting events found dispatching network-vif-plugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:38 user nova-compute[73029]: WARNING nova.compute.manager [req-a2f29421-61e7-406f-a011-4612699af2c1 req-cd610aca-7213-4dee-a9dc-087c06118cd6 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received unexpected event network-vif-plugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 for instance with vm_state building and task_state spawning.
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 60e35a85-9268-4619-991d-05598abc314d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:40:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 60e35a85-9268-4619-991d-05598abc314d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628038.3834105, 60e35a85-9268-4619-991d-05598abc314d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:40:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 60e35a85-9268-4619-991d-05598abc314d] VM Started (Lifecycle Event)
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 60e35a85-9268-4619-991d-05598abc314d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 60e35a85-9268-4619-991d-05598abc314d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:40:38 user nova-compute[73029]: INFO nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Took 6.75 seconds to spawn the instance on the hypervisor.
Aug 10 00:40:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:40:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 60e35a85-9268-4619-991d-05598abc314d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:40:38 user nova-compute[73029]: INFO nova.compute.manager [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Took 7.72 seconds to build instance.
Aug 10 00:40:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-47118963-14c1-4c32-9abe-213223c6f608 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "60e35a85-9268-4619-991d-05598abc314d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.071s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "2256b7fd-3705-438c-86d0-06dd355b4347" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "2256b7fd-3705-438c-86d0-06dd355b4347" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:45 user nova-compute[73029]: INFO nova.compute.manager [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Terminating instance
Aug 10 00:40:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-a5ce241c-50c3-4cfb-9089-6aaf0cbd298d req-b2729b05-5aa9-4fca-a259-2c78564a0612 service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received event network-vif-unplugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a5ce241c-50c3-4cfb-9089-6aaf0cbd298d req-b2729b05-5aa9-4fca-a259-2c78564a0612 service nova] Acquiring lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a5ce241c-50c3-4cfb-9089-6aaf0cbd298d req-b2729b05-5aa9-4fca-a259-2c78564a0612 service nova] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a5ce241c-50c3-4cfb-9089-6aaf0cbd298d req-b2729b05-5aa9-4fca-a259-2c78564a0612 service nova] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-a5ce241c-50c3-4cfb-9089-6aaf0cbd298d req-b2729b05-5aa9-4fca-a259-2c78564a0612 service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] No waiting events found dispatching network-vif-unplugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-a5ce241c-50c3-4cfb-9089-6aaf0cbd298d req-b2729b05-5aa9-4fca-a259-2c78564a0612 service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received event network-vif-unplugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:40:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Instance destroyed successfully.
Aug 10 00:40:46 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lazy-loading 'resources' on Instance uuid 2256b7fd-3705-438c-86d0-06dd355b4347 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:40:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1685367590',display_name='tempest-VolumesAdminNegativeTest-server-1685367590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1685367590',id=14,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:38:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65cacd78e5db48399ddb0b666498b7af',ramdisk_id='',reservation_id='r-vfts5khq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-592274289',owner_user_name='tempest-VolumesAdminNegativeTest-592274289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:38:51Z,user_data=None,user_id='2f52da2ce49444c19eac225f85e7a157',uuid=2256b7fd-3705-438c-86d0-06dd355b4347,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:40:46 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converting VIF {"id": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "address": "fa:16:3e:da:e5:df", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2615d8-c7", "ovs_interfaceid": "ce2615d8-c701-494d-9daf-40aa72e7fb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:40:46 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:e5:df,bridge_name='br-int',has_traffic_filtering=True,id=ce2615d8-c701-494d-9daf-40aa72e7fb81,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2615d8-c7') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:40:46 user nova-compute[73029]: DEBUG os_vif [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e5:df,bridge_name='br-int',has_traffic_filtering=True,id=ce2615d8-c701-494d-9daf-40aa72e7fb81,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2615d8-c7') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:40:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce2615d8-c7, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:40:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:40:46 user nova-compute[73029]: INFO os_vif [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e5:df,bridge_name='br-int',has_traffic_filtering=True,id=ce2615d8-c701-494d-9daf-40aa72e7fb81,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2615d8-c7')
Aug 10 00:40:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Deleting instance files /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347_del
Aug 10 00:40:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Deletion of /opt/stack/data/nova/instances/2256b7fd-3705-438c-86d0-06dd355b4347_del complete
Aug 10 00:40:46 user nova-compute[73029]: INFO nova.compute.manager [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 10 00:40:46 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:40:46 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:40:46 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:40:47 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Took 1.15 seconds to deallocate network for instance.
Aug 10 00:40:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-18eaf51e-6f8b-4c32-9576-0553d4adf52a req-2242fed0-c091-466a-8db4-bea729c4a774 service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received event network-vif-deleted-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:47 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Deleted allocations for instance 2256b7fd-3705-438c-86d0-06dd355b4347
Aug 10 00:40:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-dce93967-d8b7-4ac3-8907-379ba799ffc6 req-ae73a399-c3af-4bf6-8251-9ebce797c4eb service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received event network-vif-plugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-dce93967-d8b7-4ac3-8907-379ba799ffc6 req-ae73a399-c3af-4bf6-8251-9ebce797c4eb service nova] Acquiring lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-dce93967-d8b7-4ac3-8907-379ba799ffc6 req-ae73a399-c3af-4bf6-8251-9ebce797c4eb service nova] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-dce93967-d8b7-4ac3-8907-379ba799ffc6 req-ae73a399-c3af-4bf6-8251-9ebce797c4eb service nova] Lock "2256b7fd-3705-438c-86d0-06dd355b4347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-dce93967-d8b7-4ac3-8907-379ba799ffc6 req-ae73a399-c3af-4bf6-8251-9ebce797c4eb service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] No waiting events found dispatching network-vif-plugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:40:47 user nova-compute[73029]: WARNING nova.compute.manager [req-dce93967-d8b7-4ac3-8907-379ba799ffc6 req-ae73a399-c3af-4bf6-8251-9ebce797c4eb service nova] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Received unexpected event network-vif-plugged-ce2615d8-c701-494d-9daf-40aa72e7fb81 for instance with vm_state deleted and task_state None.
Aug 10 00:40:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a1898af-6f44-4341-998e-c54655d0e60c tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "2256b7fd-3705-438c-86d0-06dd355b4347" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.547s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:40:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:40:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:01 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628046.063073, 2256b7fd-3705-438c-86d0-06dd355b4347 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:01 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] VM Stopped (Lifecycle Event)
Aug 10 00:41:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-78174532-5fc6-4119-95ec-323ec418de43 None None] [instance: 2256b7fd-3705-438c-86d0-06dd355b4347] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:41:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:41:03 user nova-compute[73029]: INFO nova.compute.claims [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Claim successful on node user
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:41:04 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.policy [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3e1bb9034314565893a8d3629f8cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ad7b2647e5407b89ce46595c1fc9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:41:04 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Creating image(s)
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "/opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "/opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquiring lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.467s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:41:05 user nova-compute[73029]: INFO nova.compute.claims [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Claim successful on node user
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk 1073741824" returned: 0 in 0.067s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.537s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Cannot resize image /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'migration_context' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Successfully created port: 7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Ensure instance console log exists: /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.network.neutron [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:41:05 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:41:05 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Creating image(s)
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquiring lock "/opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "/opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "/opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG nova.policy [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5ffe13879fa42f4b40de276e9de3ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7e03aa93474bcebbce2920a374378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk 1073741824" returned: 0 in 0.063s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Cannot resize image /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG nova.objects.instance [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lazy-loading 'migration_context' on Instance uuid 73d0b469-2ef5-4903-a9c3-8d658f0f058b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Ensure instance console log exists: /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Successfully updated port: 7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquired lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.compute.manager [req-16910118-3d5a-49ad-a877-7adc3702ccb5 req-2c0fe5ee-52a8-4099-abaf-a01b6bd8308d service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-changed-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.compute.manager [req-16910118-3d5a-49ad-a877-7adc3702ccb5 req-2c0fe5ee-52a8-4099-abaf-a01b6bd8308d service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Refreshing instance network info cache due to event network-changed-7e775285-84c8-4049-9914-d6b201090b0a. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-16910118-3d5a-49ad-a877-7adc3702ccb5 req-2c0fe5ee-52a8-4099-abaf-a01b6bd8308d service nova] Acquiring lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:41:07 user nova-compute[73029]: INFO nova.compute.claims [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Claim successful on node user
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.neutron [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Successfully created port: 0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance_info_cache with network_info: [{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Releasing lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance network_info: |[{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-16910118-3d5a-49ad-a877-7adc3702ccb5 req-2c0fe5ee-52a8-4099-abaf-a01b6bd8308d service nova] Acquired lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.neutron [req-16910118-3d5a-49ad-a877-7adc3702ccb5 req-2c0fe5ee-52a8-4099-abaf-a01b6bd8308d service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Refreshing network info cache for port 7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Start _get_guest_xml network_info=[{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:41:07 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:07 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-269092502',display_name='tempest-ServerActionsTestOtherB-server-269092502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-269092502',id=19,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItzikrNamyVCnXNCeYWOUlFND2bQ8Tuk4qPbQ4GANcUlImEfJj3KUpqnSakA5oCLo1HOK7tJ0c86mCVYnqC3w/Zcx+l5l4Z97MDUOsNoNFHs+ZvBbIlKUjuqYy9iRb8Lw==',key_name='tempest-keypair-1753578335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ad7b2647e5407b89ce46595c1fc9e8',ramdisk_id='',reservation_id='r-e1uzv60r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-539813810',owner_user_name='tempest-ServerActionsTestOtherB-539813810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1bb9034314565893a8d3629f8cd0c',uuid=c4da58fe-aaf3-413d-aa56-48cf53e3a1d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converting VIF {"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'pci_devices' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:41:07 user nova-compute[73029]:   <uuid>c4da58fe-aaf3-413d-aa56-48cf53e3a1d5</uuid>
Aug 10 00:41:07 user nova-compute[73029]:   <name>instance-00000013</name>
Aug 10 00:41:07 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:41:07 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:41:07 user nova-compute[73029]:   <metadata>
Aug 10 00:41:07 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:41:07 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:41:07 user nova-compute[73029]:       <nova:name>tempest-ServerActionsTestOtherB-server-269092502</nova:name>
Aug 10 00:41:07 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:41:07</nova:creationTime>
Aug 10 00:41:07 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:41:07 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:41:07 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:41:07 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:41:07 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:41:07 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:41:07 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:41:07 user nova-compute[73029]:       <nova:owner>
Aug 10 00:41:07 user nova-compute[73029]:         <nova:user uuid="f3e1bb9034314565893a8d3629f8cd0c">tempest-ServerActionsTestOtherB-539813810-project-member</nova:user>
Aug 10 00:41:07 user nova-compute[73029]:         <nova:project uuid="74ad7b2647e5407b89ce46595c1fc9e8">tempest-ServerActionsTestOtherB-539813810</nova:project>
Aug 10 00:41:07 user nova-compute[73029]:       </nova:owner>
Aug 10 00:41:07 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:41:07 user nova-compute[73029]:       <nova:ports>
Aug 10 00:41:07 user nova-compute[73029]:         <nova:port uuid="7e775285-84c8-4049-9914-d6b201090b0a">
Aug 10 00:41:07 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 00:41:07 user nova-compute[73029]:         </nova:port>
Aug 10 00:41:07 user nova-compute[73029]:       </nova:ports>
Aug 10 00:41:07 user nova-compute[73029]:     </nova:instance>
Aug 10 00:41:07 user nova-compute[73029]:   </metadata>
Aug 10 00:41:07 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:41:07 user nova-compute[73029]:     <system>
Aug 10 00:41:07 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:41:07 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:41:07 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:41:07 user nova-compute[73029]:       <entry name="serial">c4da58fe-aaf3-413d-aa56-48cf53e3a1d5</entry>
Aug 10 00:41:07 user nova-compute[73029]:       <entry name="uuid">c4da58fe-aaf3-413d-aa56-48cf53e3a1d5</entry>
Aug 10 00:41:07 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:41:07 user nova-compute[73029]:     </system>
Aug 10 00:41:07 user nova-compute[73029]:   </sysinfo>
Aug 10 00:41:07 user nova-compute[73029]:   <os>
Aug 10 00:41:07 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:41:07 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:41:07 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:41:07 user nova-compute[73029]:   </os>
Aug 10 00:41:07 user nova-compute[73029]:   <features>
Aug 10 00:41:07 user nova-compute[73029]:     <acpi/>
Aug 10 00:41:07 user nova-compute[73029]:     <apic/>
Aug 10 00:41:07 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:41:07 user nova-compute[73029]:   </features>
Aug 10 00:41:07 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:41:07 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:41:07 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:41:07 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:41:07 user nova-compute[73029]:   </clock>
Aug 10 00:41:07 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:41:07 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:41:07 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:41:07 user nova-compute[73029]:   </cpu>
Aug 10 00:41:07 user nova-compute[73029]:   <devices>
Aug 10 00:41:07 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:41:07 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:41:07 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk"/>
Aug 10 00:41:07 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:41:07 user nova-compute[73029]:     </disk>
Aug 10 00:41:07 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:41:07 user nova-compute[73029]:       <mac address="fa:16:3e:6b:32:5a"/>
Aug 10 00:41:07 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:41:07 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:41:07 user nova-compute[73029]:       <target dev="tap7e775285-84"/>
Aug 10 00:41:07 user nova-compute[73029]:     </interface>
Aug 10 00:41:07 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:41:07 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/console.log" append="off"/>
Aug 10 00:41:07 user nova-compute[73029]:     </serial>
Aug 10 00:41:07 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:41:07 user nova-compute[73029]:     <video>
Aug 10 00:41:07 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:41:07 user nova-compute[73029]:     </video>
Aug 10 00:41:07 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:41:07 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:41:07 user nova-compute[73029]:     </rng>
Aug 10 00:41:07 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:41:07 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:41:07 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:41:07 user nova-compute[73029]:     </memballoon>
Aug 10 00:41:07 user nova-compute[73029]:   </devices>
Aug 10 00:41:07 user nova-compute[73029]: </domain>
Aug 10 00:41:07 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-269092502',display_name='tempest-ServerActionsTestOtherB-server-269092502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-269092502',id=19,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItzikrNamyVCnXNCeYWOUlFND2bQ8Tuk4qPbQ4GANcUlImEfJj3KUpqnSakA5oCLo1HOK7tJ0c86mCVYnqC3w/Zcx+l5l4Z97MDUOsNoNFHs+ZvBbIlKUjuqYy9iRb8Lw==',key_name='tempest-keypair-1753578335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74ad7b2647e5407b89ce46595c1fc9e8',ramdisk_id='',reservation_id='r-e1uzv60r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-539813810',owner_user_name='tempest-ServerActionsTestOtherB-539813810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1bb9034314565893a8d3629f8cd0c',uuid=c4da58fe-aaf3-413d-aa56-48cf53e3a1d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converting VIF {"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG os_vif [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e775285-84, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e775285-84, col_values=(('external_ids', {'iface-id': '7e775285-84c8-4049-9914-d6b201090b0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:32:5a', 'vm-uuid': 'c4da58fe-aaf3-413d-aa56-48cf53e3a1d5'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:07 user nova-compute[73029]: INFO os_vif [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84')
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:41:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] No VIF found with MAC fa:16:3e:6b:32:5a, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG nova.network.neutron [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:41:08 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:41:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:41:08 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Creating image(s)
Aug 10 00:41:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "/opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "/opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "/opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "a317d37f4688335dca698cfebe1afacca81edbee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "a317d37f4688335dca698cfebe1afacca81edbee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.network.neutron [req-16910118-3d5a-49ad-a877-7adc3702ccb5 req-2c0fe5ee-52a8-4099-abaf-a01b6bd8308d service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updated VIF entry in instance network info cache for port 7e775285-84c8-4049-9914-d6b201090b0a. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.network.neutron [req-16910118-3d5a-49ad-a877-7adc3702ccb5 req-2c0fe5ee-52a8-4099-abaf-a01b6bd8308d service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance_info_cache with network_info: [{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.policy [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4fd570e277240d1b7c1b910a9289aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdf72afe44346ebae59db7a6d57a787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-16910118-3d5a-49ad-a877-7adc3702ccb5 req-2c0fe5ee-52a8-4099-abaf-a01b6bd8308d service nova] Releasing lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee.part --force-share --output=json" returned: 0 in 0.155s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.virt.images [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] a16bbdbd-1f9c-4f09-a0bd-e377815e3823 was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee.part /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee.part /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee.converted" returned: 0 in 0.236s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.network.neutron [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Successfully updated port: 0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquiring lock "refresh_cache-73d0b469-2ef5-4903-a9c3-8d658f0f058b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquired lock "refresh_cache-73d0b469-2ef5-4903-a9c3-8d658f0f058b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.network.neutron [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-20cf6b27-014f-46e8-b613-2e38905571df req-e9d7cf74-0f1b-4070-b69f-7b062754aa4c service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received event network-changed-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-20cf6b27-014f-46e8-b613-2e38905571df req-e9d7cf74-0f1b-4070-b69f-7b062754aa4c service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Refreshing instance network info cache due to event network-changed-0a31d21d-14d0-4144-931b-6e7ca73c81ae. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-20cf6b27-014f-46e8-b613-2e38905571df req-e9d7cf74-0f1b-4070-b69f-7b062754aa4c service nova] Acquiring lock "refresh_cache-73d0b469-2ef5-4903-a9c3-8d658f0f058b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "a317d37f4688335dca698cfebe1afacca81edbee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.174s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-3bcda0f0-95a3-44b2-8cf1-b71a65647d71 req-5ec21622-2449-47f6-901b-e11e6a6f7f43 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3bcda0f0-95a3-44b2-8cf1-b71a65647d71 req-5ec21622-2449-47f6-901b-e11e6a6f7f43 service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3bcda0f0-95a3-44b2-8cf1-b71a65647d71 req-5ec21622-2449-47f6-901b-e11e6a6f7f43 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3bcda0f0-95a3-44b2-8cf1-b71a65647d71 req-5ec21622-2449-47f6-901b-e11e6a6f7f43 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-3bcda0f0-95a3-44b2-8cf1-b71a65647d71 req-5ec21622-2449-47f6-901b-e11e6a6f7f43 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:09 user nova-compute[73029]: WARNING nova.compute.manager [req-3bcda0f0-95a3-44b2-8cf1-b71a65647d71 req-5ec21622-2449-47f6-901b-e11e6a6f7f43 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state building and task_state spawning.
Aug 10 00:41:09 user nova-compute[73029]: DEBUG nova.network.neutron [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee --force-share --output=json" returned: 0 in 0.155s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "a317d37f4688335dca698cfebe1afacca81edbee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "a317d37f4688335dca698cfebe1afacca81edbee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee --force-share --output=json" returned: 0 in 0.159s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee,backing_fmt=raw /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee,backing_fmt=raw /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk 1073741824" returned: 0 in 0.053s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "a317d37f4688335dca698cfebe1afacca81edbee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Successfully created port: be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee --force-share --output=json" returned: 0 in 0.187s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Checking if we can resize image /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Updating instance_info_cache with network_info: [{"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Releasing lock "refresh_cache-73d0b469-2ef5-4903-a9c3-8d658f0f058b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Instance network_info: |[{"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-20cf6b27-014f-46e8-b613-2e38905571df req-e9d7cf74-0f1b-4070-b69f-7b062754aa4c service nova] Acquired lock "refresh_cache-73d0b469-2ef5-4903-a9c3-8d658f0f058b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.network.neutron [req-20cf6b27-014f-46e8-b613-2e38905571df req-e9d7cf74-0f1b-4070-b69f-7b062754aa4c service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Refreshing network info cache for port 0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Start _get_guest_xml network_info=[{"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:41:10 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:10 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-313068804',display_name='tempest-VolumesNegativeTest-instance-313068804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-313068804',id=20,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a7e03aa93474bcebbce2920a374378f',ramdisk_id='',reservation_id='r-t08d49bn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-220084073',owner_user_name='tempest-VolumesNegativeTest-220084073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:41:06Z,user_data=None,user_id='f5ffe13879fa42f4b40de276e9de3ae8',uuid=73d0b469-2ef5-4903-a9c3-8d658f0f058b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Converting VIF {"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:15:31,bridge_name='br-int',has_traffic_filtering=True,id=0a31d21d-14d0-4144-931b-6e7ca73c81ae,network=Network(65970639-5514-427c-8966-eb97f898b8a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a31d21d-14') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lazy-loading 'pci_devices' on Instance uuid 73d0b469-2ef5-4903-a9c3-8d658f0f058b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Cannot resize image /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'migration_context' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:41:10 user nova-compute[73029]:   <uuid>73d0b469-2ef5-4903-a9c3-8d658f0f058b</uuid>
Aug 10 00:41:10 user nova-compute[73029]:   <name>instance-00000014</name>
Aug 10 00:41:10 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:41:10 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:41:10 user nova-compute[73029]:   <metadata>
Aug 10 00:41:10 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:41:10 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:41:10 user nova-compute[73029]:       <nova:name>tempest-VolumesNegativeTest-instance-313068804</nova:name>
Aug 10 00:41:10 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:41:10</nova:creationTime>
Aug 10 00:41:10 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:41:10 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:41:10 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:41:10 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:41:10 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:41:10 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:41:10 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:41:10 user nova-compute[73029]:       <nova:owner>
Aug 10 00:41:10 user nova-compute[73029]:         <nova:user uuid="f5ffe13879fa42f4b40de276e9de3ae8">tempest-VolumesNegativeTest-220084073-project-member</nova:user>
Aug 10 00:41:10 user nova-compute[73029]:         <nova:project uuid="9a7e03aa93474bcebbce2920a374378f">tempest-VolumesNegativeTest-220084073</nova:project>
Aug 10 00:41:10 user nova-compute[73029]:       </nova:owner>
Aug 10 00:41:10 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:41:10 user nova-compute[73029]:       <nova:ports>
Aug 10 00:41:10 user nova-compute[73029]:         <nova:port uuid="0a31d21d-14d0-4144-931b-6e7ca73c81ae">
Aug 10 00:41:10 user nova-compute[73029]:           <nova:ip type="fixed" address="192.168.233.42" ipVersion="4"/>
Aug 10 00:41:10 user nova-compute[73029]:         </nova:port>
Aug 10 00:41:10 user nova-compute[73029]:       </nova:ports>
Aug 10 00:41:10 user nova-compute[73029]:     </nova:instance>
Aug 10 00:41:10 user nova-compute[73029]:   </metadata>
Aug 10 00:41:10 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:41:10 user nova-compute[73029]:     <system>
Aug 10 00:41:10 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:41:10 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:41:10 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:41:10 user nova-compute[73029]:       <entry name="serial">73d0b469-2ef5-4903-a9c3-8d658f0f058b</entry>
Aug 10 00:41:10 user nova-compute[73029]:       <entry name="uuid">73d0b469-2ef5-4903-a9c3-8d658f0f058b</entry>
Aug 10 00:41:10 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:41:10 user nova-compute[73029]:     </system>
Aug 10 00:41:10 user nova-compute[73029]:   </sysinfo>
Aug 10 00:41:10 user nova-compute[73029]:   <os>
Aug 10 00:41:10 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:41:10 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:41:10 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:41:10 user nova-compute[73029]:   </os>
Aug 10 00:41:10 user nova-compute[73029]:   <features>
Aug 10 00:41:10 user nova-compute[73029]:     <acpi/>
Aug 10 00:41:10 user nova-compute[73029]:     <apic/>
Aug 10 00:41:10 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:41:10 user nova-compute[73029]:   </features>
Aug 10 00:41:10 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:41:10 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:41:10 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:41:10 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:41:10 user nova-compute[73029]:   </clock>
Aug 10 00:41:10 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:41:10 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:41:10 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:41:10 user nova-compute[73029]:   </cpu>
Aug 10 00:41:10 user nova-compute[73029]:   <devices>
Aug 10 00:41:10 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:41:10 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:41:10 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk"/>
Aug 10 00:41:10 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:41:10 user nova-compute[73029]:     </disk>
Aug 10 00:41:10 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:41:10 user nova-compute[73029]:       <mac address="fa:16:3e:c3:15:31"/>
Aug 10 00:41:10 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:41:10 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:41:10 user nova-compute[73029]:       <target dev="tap0a31d21d-14"/>
Aug 10 00:41:10 user nova-compute[73029]:     </interface>
Aug 10 00:41:10 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:41:10 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/console.log" append="off"/>
Aug 10 00:41:10 user nova-compute[73029]:     </serial>
Aug 10 00:41:10 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:41:10 user nova-compute[73029]:     <video>
Aug 10 00:41:10 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:41:10 user nova-compute[73029]:     </video>
Aug 10 00:41:10 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:41:10 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:41:10 user nova-compute[73029]:     </rng>
Aug 10 00:41:10 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:41:10 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:41:10 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:41:10 user nova-compute[73029]:     </memballoon>
Aug 10 00:41:10 user nova-compute[73029]:   </devices>
Aug 10 00:41:10 user nova-compute[73029]: </domain>
Aug 10 00:41:10 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-313068804',display_name='tempest-VolumesNegativeTest-instance-313068804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-313068804',id=20,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a7e03aa93474bcebbce2920a374378f',ramdisk_id='',reservation_id='r-t08d49bn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-220084073',owner_user_name='tempest-VolumesNegativeTest-220084073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:41:06Z,user_data=None,user_id='f5ffe13879fa42f4b40de276e9de3ae8',uuid=73d0b469-2ef5-4903-a9c3-8d658f0f058b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Converting VIF {"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:15:31,bridge_name='br-int',has_traffic_filtering=True,id=0a31d21d-14d0-4144-931b-6e7ca73c81ae,network=Network(65970639-5514-427c-8966-eb97f898b8a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a31d21d-14') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG os_vif [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:15:31,bridge_name='br-int',has_traffic_filtering=True,id=0a31d21d-14d0-4144-931b-6e7ca73c81ae,network=Network(65970639-5514-427c-8966-eb97f898b8a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a31d21d-14') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Ensure instance console log exists: /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a31d21d-14, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a31d21d-14, col_values=(('external_ids', {'iface-id': '0a31d21d-14d0-4144-931b-6e7ca73c81ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:15:31', 'vm-uuid': '73d0b469-2ef5-4903-a9c3-8d658f0f058b'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:41:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:10 user nova-compute[73029]: INFO os_vif [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:15:31,bridge_name='br-int',has_traffic_filtering=True,id=0a31d21d-14d0-4144-931b-6e7ca73c81ae,network=Network(65970639-5514-427c-8966-eb97f898b8a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a31d21d-14')
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-20cf6b27-014f-46e8-b613-2e38905571df req-e9d7cf74-0f1b-4070-b69f-7b062754aa4c service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Updated VIF entry in instance network info cache for port 0a31d21d-14d0-4144-931b-6e7ca73c81ae. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-20cf6b27-014f-46e8-b613-2e38905571df req-e9d7cf74-0f1b-4070-b69f-7b062754aa4c service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Updating instance_info_cache with network_info: [{"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] No VIF found with MAC fa:16:3e:c3:15:31, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-20cf6b27-014f-46e8-b613-2e38905571df req-e9d7cf74-0f1b-4070-b69f-7b062754aa4c service nova] Releasing lock "refresh_cache-73d0b469-2ef5-4903-a9c3-8d658f0f058b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.network.neutron [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Successfully updated port: be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquired lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.network.neutron [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.network.neutron [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-9c700dc5-a559-41d3-90b7-9f4e5ccf5150 req-443348b8-5af5-4d11-8d10-94b43a0a0d44 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-9c700dc5-a559-41d3-90b7-9f4e5ccf5150 req-443348b8-5af5-4d11-8d10-94b43a0a0d44 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing instance network info cache due to event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9c700dc5-a559-41d3-90b7-9f4e5ccf5150 req-443348b8-5af5-4d11-8d10-94b43a0a0d44 service nova] Acquiring lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-fc417eef-376e-485c-88fb-c061601cc53e req-ce104f0c-bf13-475a-b63d-5bb82b0f3c0d service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fc417eef-376e-485c-88fb-c061601cc53e req-ce104f0c-bf13-475a-b63d-5bb82b0f3c0d service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fc417eef-376e-485c-88fb-c061601cc53e req-ce104f0c-bf13-475a-b63d-5bb82b0f3c0d service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fc417eef-376e-485c-88fb-c061601cc53e req-ce104f0c-bf13-475a-b63d-5bb82b0f3c0d service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-fc417eef-376e-485c-88fb-c061601cc53e req-ce104f0c-bf13-475a-b63d-5bb82b0f3c0d service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:11 user nova-compute[73029]: WARNING nova.compute.manager [req-fc417eef-376e-485c-88fb-c061601cc53e req-ce104f0c-bf13-475a-b63d-5bb82b0f3c0d service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state building and task_state spawning.
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.network.neutron [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updating instance_info_cache with network_info: [{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Releasing lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Instance network_info: |[{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9c700dc5-a559-41d3-90b7-9f4e5ccf5150 req-443348b8-5af5-4d11-8d10-94b43a0a0d44 service nova] Acquired lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-9c700dc5-a559-41d3-90b7-9f4e5ccf5150 req-443348b8-5af5-4d11-8d10-94b43a0a0d44 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Start _get_guest_xml network_info=[{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:41:03Z,direct_url=<?>,disk_format='qcow2',id=a16bbdbd-1f9c-4f09-a0bd-e377815e3823,min_disk=0,min_ram=0,name='tempest-scenario-img--72218487',owner='2bdf72afe44346ebae59db7a6d57a787',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:41:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': 'a16bbdbd-1f9c-4f09-a0bd-e377815e3823'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:41:11 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:11 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:41:03Z,direct_url=<?>,disk_format='qcow2',id=a16bbdbd-1f9c-4f09-a0bd-e377815e3823,min_disk=0,min_ram=0,name='tempest-scenario-img--72218487',owner='2bdf72afe44346ebae59db7a6d57a787',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:41:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:41:11 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724206694',display_name='tempest-TestMinimumBasicScenario-server-724206694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724206694',id=21,image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyvuwaNsaWL2ieB5B79GJsBSEJ1Puvg7jYv05H2n+tMu8V79v3UFwmPyW2Gxwu3XdgLMPSnIB+Cj/GsdfVHMUSkaSjDi1U1zPbizPUbOfg7Bwx1n4YcjkMP0EKGUBAW1A==',key_name='tempest-TestMinimumBasicScenario-943275705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bdf72afe44346ebae59db7a6d57a787',ramdisk_id='',reservation_id='r-cu10n5db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-379185014',owner_user_name='tempest-TestMinimumBasicScenario-379185014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:41:08Z,user_data=None,user_id='e4fd570e277240d1b7c1b910a9289aad',uuid=872fce9b-adf0-4c6f-820e-0d76b59ea36d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converting VIF {"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.objects.instance [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'pci_devices' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628072.0009778, c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] VM Resumed (Lifecycle Event)
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:41:12 user nova-compute[73029]:   <uuid>872fce9b-adf0-4c6f-820e-0d76b59ea36d</uuid>
Aug 10 00:41:12 user nova-compute[73029]:   <name>instance-00000015</name>
Aug 10 00:41:12 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:41:12 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:41:12 user nova-compute[73029]:   <metadata>
Aug 10 00:41:12 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:41:12 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:41:12 user nova-compute[73029]:       <nova:name>tempest-TestMinimumBasicScenario-server-724206694</nova:name>
Aug 10 00:41:12 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:41:11</nova:creationTime>
Aug 10 00:41:12 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:41:12 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:41:12 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:41:12 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:41:12 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:41:12 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:41:12 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:41:12 user nova-compute[73029]:       <nova:owner>
Aug 10 00:41:12 user nova-compute[73029]:         <nova:user uuid="e4fd570e277240d1b7c1b910a9289aad">tempest-TestMinimumBasicScenario-379185014-project-member</nova:user>
Aug 10 00:41:12 user nova-compute[73029]:         <nova:project uuid="2bdf72afe44346ebae59db7a6d57a787">tempest-TestMinimumBasicScenario-379185014</nova:project>
Aug 10 00:41:12 user nova-compute[73029]:       </nova:owner>
Aug 10 00:41:12 user nova-compute[73029]:       <nova:root type="image" uuid="a16bbdbd-1f9c-4f09-a0bd-e377815e3823"/>
Aug 10 00:41:12 user nova-compute[73029]:       <nova:ports>
Aug 10 00:41:12 user nova-compute[73029]:         <nova:port uuid="be6b05f6-41c0-47d0-b2a1-e9a5619ce08b">
Aug 10 00:41:12 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 10 00:41:12 user nova-compute[73029]:         </nova:port>
Aug 10 00:41:12 user nova-compute[73029]:       </nova:ports>
Aug 10 00:41:12 user nova-compute[73029]:     </nova:instance>
Aug 10 00:41:12 user nova-compute[73029]:   </metadata>
Aug 10 00:41:12 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:41:12 user nova-compute[73029]:     <system>
Aug 10 00:41:12 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:41:12 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:41:12 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:41:12 user nova-compute[73029]:       <entry name="serial">872fce9b-adf0-4c6f-820e-0d76b59ea36d</entry>
Aug 10 00:41:12 user nova-compute[73029]:       <entry name="uuid">872fce9b-adf0-4c6f-820e-0d76b59ea36d</entry>
Aug 10 00:41:12 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:41:12 user nova-compute[73029]:     </system>
Aug 10 00:41:12 user nova-compute[73029]:   </sysinfo>
Aug 10 00:41:12 user nova-compute[73029]:   <os>
Aug 10 00:41:12 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:41:12 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:41:12 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:41:12 user nova-compute[73029]:   </os>
Aug 10 00:41:12 user nova-compute[73029]:   <features>
Aug 10 00:41:12 user nova-compute[73029]:     <acpi/>
Aug 10 00:41:12 user nova-compute[73029]:     <apic/>
Aug 10 00:41:12 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:41:12 user nova-compute[73029]:   </features>
Aug 10 00:41:12 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:41:12 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:41:12 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:41:12 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:41:12 user nova-compute[73029]:   </clock>
Aug 10 00:41:12 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:41:12 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:41:12 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:41:12 user nova-compute[73029]:   </cpu>
Aug 10 00:41:12 user nova-compute[73029]:   <devices>
Aug 10 00:41:12 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:41:12 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:41:12 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk"/>
Aug 10 00:41:12 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:41:12 user nova-compute[73029]:     </disk>
Aug 10 00:41:12 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:41:12 user nova-compute[73029]:       <mac address="fa:16:3e:b5:50:03"/>
Aug 10 00:41:12 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:41:12 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:41:12 user nova-compute[73029]:       <target dev="tapbe6b05f6-41"/>
Aug 10 00:41:12 user nova-compute[73029]:     </interface>
Aug 10 00:41:12 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:41:12 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/console.log" append="off"/>
Aug 10 00:41:12 user nova-compute[73029]:     </serial>
Aug 10 00:41:12 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:41:12 user nova-compute[73029]:     <video>
Aug 10 00:41:12 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:41:12 user nova-compute[73029]:     </video>
Aug 10 00:41:12 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:41:12 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:41:12 user nova-compute[73029]:     </rng>
Aug 10 00:41:12 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:41:12 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:41:12 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:41:12 user nova-compute[73029]:     </memballoon>
Aug 10 00:41:12 user nova-compute[73029]:   </devices>
Aug 10 00:41:12 user nova-compute[73029]: </domain>
Aug 10 00:41:12 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724206694',display_name='tempest-TestMinimumBasicScenario-server-724206694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724206694',id=21,image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyvuwaNsaWL2ieB5B79GJsBSEJ1Puvg7jYv05H2n+tMu8V79v3UFwmPyW2Gxwu3XdgLMPSnIB+Cj/GsdfVHMUSkaSjDi1U1zPbizPUbOfg7Bwx1n4YcjkMP0EKGUBAW1A==',key_name='tempest-TestMinimumBasicScenario-943275705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bdf72afe44346ebae59db7a6d57a787',ramdisk_id='',reservation_id='r-cu10n5db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-379185014',owner_user_name='tempest-TestMinimumBasicScenario-379185014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:41:08Z,user_data=None,user_id='e4fd570e277240d1b7c1b910a9289aad',uuid=872fce9b-adf0-4c6f-820e-0d76b59ea36d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converting VIF {"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG os_vif [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe6b05f6-41, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe6b05f6-41, col_values=(('external_ids', {'iface-id': 'be6b05f6-41c0-47d0-b2a1-e9a5619ce08b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:50:03', 'vm-uuid': '872fce9b-adf0-4c6f-820e-0d76b59ea36d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance spawned successfully.
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:12 user nova-compute[73029]: INFO os_vif [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41')
Aug 10 00:41:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:41:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628072.0012412, c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] VM Started (Lifecycle Event)
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:41:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No VIF found with MAC fa:16:3e:b5:50:03, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 00:41:12 user nova-compute[73029]: INFO nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Took 7.68 seconds to spawn the instance on the hypervisor.
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:12 user nova-compute[73029]: INFO nova.compute.manager [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Took 8.53 seconds to build instance.
Aug 10 00:41:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f8105476-f584-458b-a047-a5b1b3aa9508 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.647s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.network.neutron [req-9c700dc5-a559-41d3-90b7-9f4e5ccf5150 req-443348b8-5af5-4d11-8d10-94b43a0a0d44 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updated VIF entry in instance network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG nova.network.neutron [req-9c700dc5-a559-41d3-90b7-9f4e5ccf5150 req-443348b8-5af5-4d11-8d10-94b43a0a0d44 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updating instance_info_cache with network_info: [{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9c700dc5-a559-41d3-90b7-9f4e5ccf5150 req-443348b8-5af5-4d11-8d10-94b43a0a0d44 service nova] Releasing lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received event network-vif-plugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] Acquiring lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] No waiting events found dispatching network-vif-plugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:13 user nova-compute[73029]: WARNING nova.compute.manager [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received unexpected event network-vif-plugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae for instance with vm_state building and task_state spawning.
Aug 10 00:41:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received event network-vif-plugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] Acquiring lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] No waiting events found dispatching network-vif-plugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:13 user nova-compute[73029]: WARNING nova.compute.manager [req-997268c7-3f07-44ba-ba37-2ebc5f155d4e req-dd499c01-07d1-4ebc-91cf-fa286e073467 service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received unexpected event network-vif-plugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae for instance with vm_state building and task_state spawning.
Aug 10 00:41:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628075.7682977, 73d0b469-2ef5-4903-a9c3-8d658f0f058b => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:15 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] VM Resumed (Lifecycle Event)
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:41:15 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Instance spawned successfully.
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:15 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628075.7698615, 73d0b469-2ef5-4903-a9c3-8d658f0f058b => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:15 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] VM Started (Lifecycle Event)
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] No waiting events found dispatching network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:15 user nova-compute[73029]: WARNING nova.compute.manager [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received unexpected event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b for instance with vm_state building and task_state spawning.
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] No waiting events found dispatching network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:15 user nova-compute[73029]: WARNING nova.compute.manager [req-b7efd1d6-93fc-49b5-b379-8080fe929bce req-45b826be-cf9a-45b1-a8d8-3cdf3f71e9e3 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received unexpected event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b for instance with vm_state building and task_state spawning.
Aug 10 00:41:15 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:41:15 user nova-compute[73029]: INFO nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Took 9.96 seconds to spawn the instance on the hypervisor.
Aug 10 00:41:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:16 user nova-compute[73029]: INFO nova.compute.manager [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Took 11.63 seconds to build instance.
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628076.3438032, 872fce9b-adf0-4c6f-820e-0d76b59ea36d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:16 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] VM Resumed (Lifecycle Event)
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:41:16 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Instance spawned successfully.
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29f85732-b5c3-451e-8cf0-59404e203b7c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.811s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:41:16 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628076.3448846, 872fce9b-adf0-4c6f-820e-0d76b59ea36d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:16 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] VM Started (Lifecycle Event)
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:41:16 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:41:16 user nova-compute[73029]: INFO nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Took 7.89 seconds to spawn the instance on the hypervisor.
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:16 user nova-compute[73029]: INFO nova.compute.manager [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Took 8.93 seconds to build instance.
Aug 10 00:41:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-20b7dc66-52bc-48ed-a56f-7f126e13cc33 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.048s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:16 user nova-compute[73029]: INFO nova.compute.manager [None req-9c22f20e-86f6-44f8-bfaf-405b0c8a6d78 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Unrescuing
Aug 10 00:41:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9c22f20e-86f6-44f8-bfaf-405b0c8a6d78 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9c22f20e-86f6-44f8-bfaf-405b0c8a6d78 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquired lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-9c22f20e-86f6-44f8-bfaf-405b0c8a6d78 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-9c22f20e-86f6-44f8-bfaf-405b0c8a6d78 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating instance_info_cache with network_info: [{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9c22f20e-86f6-44f8-bfaf-405b0c8a6d78 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Releasing lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9c22f20e-86f6-44f8-bfaf-405b0c8a6d78 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'flavor' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG nova.compute.manager [req-59bed5c8-9d60-48e5-9195-7fe0f295687c req-28bb7101-05ec-49b0-a300-b3091e9688a6 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-unplugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-59bed5c8-9d60-48e5-9195-7fe0f295687c req-28bb7101-05ec-49b0-a300-b3091e9688a6 service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-59bed5c8-9d60-48e5-9195-7fe0f295687c req-28bb7101-05ec-49b0-a300-b3091e9688a6 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-59bed5c8-9d60-48e5-9195-7fe0f295687c req-28bb7101-05ec-49b0-a300-b3091e9688a6 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:17 user nova-compute[73029]: DEBUG nova.compute.manager [req-59bed5c8-9d60-48e5-9195-7fe0f295687c req-28bb7101-05ec-49b0-a300-b3091e9688a6 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-unplugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:17 user nova-compute[73029]: WARNING nova.compute.manager [req-59bed5c8-9d60-48e5-9195-7fe0f295687c req-28bb7101-05ec-49b0-a300-b3091e9688a6 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-unplugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:41:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:41:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Instance destroyed successfully.
Aug 10 00:41:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-b0d9ea8a-25a4-41ab-8f57-5407f3ed4e31 req-5fdc96ca-4fb0-4555-9185-2e58fc27786e service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-changed-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-b0d9ea8a-25a4-41ab-8f57-5407f3ed4e31 req-5fdc96ca-4fb0-4555-9185-2e58fc27786e service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Refreshing instance network info cache due to event network-changed-ce93d51f-3ef0-48a2-b705-1a2d12fcccac. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b0d9ea8a-25a4-41ab-8f57-5407f3ed4e31 req-5fdc96ca-4fb0-4555-9185-2e58fc27786e service nova] Acquiring lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b0d9ea8a-25a4-41ab-8f57-5407f3ed4e31 req-5fdc96ca-4fb0-4555-9185-2e58fc27786e service nova] Acquired lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:18 user nova-compute[73029]: DEBUG nova.network.neutron [req-b0d9ea8a-25a4-41ab-8f57-5407f3ed4e31 req-5fdc96ca-4fb0-4555-9185-2e58fc27786e service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Refreshing network info cache for port ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:41:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-b0d9ea8a-25a4-41ab-8f57-5407f3ed4e31 req-5fdc96ca-4fb0-4555-9185-2e58fc27786e service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updated VIF entry in instance network info cache for port ce93d51f-3ef0-48a2-b705-1a2d12fcccac. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:41:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-b0d9ea8a-25a4-41ab-8f57-5407f3ed4e31 req-5fdc96ca-4fb0-4555-9185-2e58fc27786e service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating instance_info_cache with network_info: [{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b0d9ea8a-25a4-41ab-8f57-5407f3ed4e31 req-5fdc96ca-4fb0-4555-9185-2e58fc27786e service nova] Releasing lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-07d61ad2-a327-4c60-9e0e-1db3ef5c8db8 req-0ef2c950-6eff-413c-9fe7-b828cde04119 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-07d61ad2-a327-4c60-9e0e-1db3ef5c8db8 req-0ef2c950-6eff-413c-9fe7-b828cde04119 service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-07d61ad2-a327-4c60-9e0e-1db3ef5c8db8 req-0ef2c950-6eff-413c-9fe7-b828cde04119 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-07d61ad2-a327-4c60-9e0e-1db3ef5c8db8 req-0ef2c950-6eff-413c-9fe7-b828cde04119 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-07d61ad2-a327-4c60-9e0e-1db3ef5c8db8 req-0ef2c950-6eff-413c-9fe7-b828cde04119 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:20 user nova-compute[73029]: WARNING nova.compute.manager [req-07d61ad2-a327-4c60-9e0e-1db3ef5c8db8 req-0ef2c950-6eff-413c-9fe7-b828cde04119 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:41:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-68df639c-93a4-49c9-8f36-fc5da09960a3 req-78800435-a9b7-46f3-84ab-51f722e374b7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-changed-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-68df639c-93a4-49c9-8f36-fc5da09960a3 req-78800435-a9b7-46f3-84ab-51f722e374b7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Refreshing instance network info cache due to event network-changed-ce93d51f-3ef0-48a2-b705-1a2d12fcccac. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-68df639c-93a4-49c9-8f36-fc5da09960a3 req-78800435-a9b7-46f3-84ab-51f722e374b7 service nova] Acquiring lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-68df639c-93a4-49c9-8f36-fc5da09960a3 req-78800435-a9b7-46f3-84ab-51f722e374b7 service nova] Acquired lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG nova.network.neutron [req-68df639c-93a4-49c9-8f36-fc5da09960a3 req-78800435-a9b7-46f3-84ab-51f722e374b7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Refreshing network info cache for port ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-68df639c-93a4-49c9-8f36-fc5da09960a3 req-78800435-a9b7-46f3-84ab-51f722e374b7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updated VIF entry in instance network info cache for port ce93d51f-3ef0-48a2-b705-1a2d12fcccac. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-68df639c-93a4-49c9-8f36-fc5da09960a3 req-78800435-a9b7-46f3-84ab-51f722e374b7 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating instance_info_cache with network_info: [{"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-68df639c-93a4-49c9-8f36-fc5da09960a3 req-78800435-a9b7-46f3-84ab-51f722e374b7 service nova] Releasing lock "refresh_cache-4a17123b-6ea8-450b-9ada-8c8278dcf739" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:21 user nova-compute[73029]: INFO nova.compute.manager [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Terminating instance
Aug 10 00:41:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:22 user nova-compute[73029]: WARNING nova.compute.manager [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:22 user nova-compute[73029]: WARNING nova.compute.manager [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received event network-vif-unplugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] No waiting events found dispatching network-vif-unplugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4512b816-a387-4c21-b09e-651940598bcf req-ea8fe71b-0da2-4b85-9ffe-c1345e459b50 service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received event network-vif-unplugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Instance destroyed successfully.
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.objects.instance [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'resources' on Instance uuid aa5be433-9c8a-4e52-b61d-15a84f188cc3 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247021724',display_name='tempest-AttachVolumeNegativeTest-server-1247021724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247021724',id=4,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbBLDKbApinGC6hgdl3zET+Qq1wfPABVRqzeZYVhFC6RsKoiCsbNGrzctbFgafQPrTWh0Hi7qBkTjwiP9Sq/ZIsb8NerlLBLz9aX7q77BYjFk/Qz+F5wsiWkczdnywdgQ==',key_name='tempest-keypair-206874666',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-3opc60ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=aa5be433-9c8a-4e52-b61d-15a84f188cc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "address": "fa:16:3e:a1:9b:d7", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf2d6d9-ff", "ovs_interfaceid": "fdf2d6d9-ffa0-4264-9bef-d602571f44e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:9b:d7,bridge_name='br-int',has_traffic_filtering=True,id=fdf2d6d9-ffa0-4264-9bef-d602571f44e4,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf2d6d9-ff') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG os_vif [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:9b:d7,bridge_name='br-int',has_traffic_filtering=True,id=fdf2d6d9-ffa0-4264-9bef-d602571f44e4,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf2d6d9-ff') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdf2d6d9-ff, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:41:22 user nova-compute[73029]: INFO os_vif [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:9b:d7,bridge_name='br-int',has_traffic_filtering=True,id=fdf2d6d9-ffa0-4264-9bef-d602571f44e4,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf2d6d9-ff')
Aug 10 00:41:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Deleting instance files /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3_del
Aug 10 00:41:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Deletion of /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3_del complete
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json" returned: 1 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk --force-share --output=json' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:41:22 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000004, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/aa5be433-9c8a-4e52-b61d-15a84f188cc3/disk
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:22 user nova-compute[73029]: INFO nova.compute.manager [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 4a17123b-6ea8-450b-9ada-8c8278dcf739 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628082.6970508, 4a17123b-6ea8-450b-9ada-8c8278dcf739 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] VM Resumed (Lifecycle Event)
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9c22f20e-86f6-44f8-bfaf-405b0c8a6d78 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628082.706313, 4a17123b-6ea8-450b-9ada-8c8278dcf739 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] VM Started (Lifecycle Event)
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:23 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Took 1.07 seconds to deallocate network for instance.
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-061babd8-4a79-44d7-97d4-edf5f95ecbc2 req-962a904b-bfe1-4a08-8f2a-9f856d88e20b service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received event network-vif-plugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-061babd8-4a79-44d7-97d4-edf5f95ecbc2 req-962a904b-bfe1-4a08-8f2a-9f856d88e20b service nova] Acquiring lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-061babd8-4a79-44d7-97d4-edf5f95ecbc2 req-962a904b-bfe1-4a08-8f2a-9f856d88e20b service nova] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-061babd8-4a79-44d7-97d4-edf5f95ecbc2 req-962a904b-bfe1-4a08-8f2a-9f856d88e20b service nova] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-061babd8-4a79-44d7-97d4-edf5f95ecbc2 req-962a904b-bfe1-4a08-8f2a-9f856d88e20b service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] No waiting events found dispatching network-vif-plugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:24 user nova-compute[73029]: WARNING nova.compute.manager [req-061babd8-4a79-44d7-97d4-edf5f95ecbc2 req-962a904b-bfe1-4a08-8f2a-9f856d88e20b service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received unexpected event network-vif-plugged-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 for instance with vm_state deleted and task_state None.
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-061babd8-4a79-44d7-97d4-edf5f95ecbc2 req-962a904b-bfe1-4a08-8f2a-9f856d88e20b service nova] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Received event network-vif-deleted-fdf2d6d9-ffa0-4264-9bef-d602571f44e4 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.928s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:25 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Deleted allocations for instance aa5be433-9c8a-4e52-b61d-15a84f188cc3
Aug 10 00:41:25 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:25 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7348MB free_disk=25.210697174072266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dc337418-2f23-45a9-b9e0-ed4b1f69c43b tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "aa5be433-9c8a-4e52-b61d-15a84f188cc3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.845s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 5e356ed0-276c-4a27-9294-3176cc022c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 60e35a85-9268-4619-991d-05598abc314d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 73d0b469-2ef5-4903-a9c3-8d658f0f058b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:41:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:41:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:41:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:28 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:41:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:37 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628082.462325, aa5be433-9c8a-4e52-b61d-15a84f188cc3 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:37 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] VM Stopped (Lifecycle Event)
Aug 10 00:41:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-54321ba7-9eb8-4a8d-8abe-1505450b514e None None] [instance: aa5be433-9c8a-4e52-b61d-15a84f188cc3] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Terminating instance
Aug 10 00:41:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:41:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-bee331f7-8ca6-4d94-8dda-7e32bd1718ef req-1fb4ae7a-1413-4513-884e-78de889d5109 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received event network-vif-unplugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bee331f7-8ca6-4d94-8dda-7e32bd1718ef req-1fb4ae7a-1413-4513-884e-78de889d5109 service nova] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bee331f7-8ca6-4d94-8dda-7e32bd1718ef req-1fb4ae7a-1413-4513-884e-78de889d5109 service nova] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bee331f7-8ca6-4d94-8dda-7e32bd1718ef req-1fb4ae7a-1413-4513-884e-78de889d5109 service nova] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-bee331f7-8ca6-4d94-8dda-7e32bd1718ef req-1fb4ae7a-1413-4513-884e-78de889d5109 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] No waiting events found dispatching network-vif-unplugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-bee331f7-8ca6-4d94-8dda-7e32bd1718ef req-1fb4ae7a-1413-4513-884e-78de889d5109 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received event network-vif-unplugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:42 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Instance destroyed successfully.
Aug 10 00:41:42 user nova-compute[73029]: DEBUG nova.objects.instance [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lazy-loading 'resources' on Instance uuid e7d1898b-0b2e-4feb-9d06-48e20eb9e409 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-580676524',display_name='tempest-VolumesAdminNegativeTest-server-580676524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-580676524',id=5,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdfpZynWc2SoMa3N4a4J9AI9cj4/d4XXJ7kInHnSYtEAImImHbLqEWNnEsXx4aJaUVHj9rTvZUW+Ocr/m59/UNfJgXqRfg/ElWs7ikwbXvNU3gbnnauym7PXHJzYUmnpg==',key_name='tempest-keypair-1869316900',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:35:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65cacd78e5db48399ddb0b666498b7af',ramdisk_id='',reservation_id='r-t42o6h0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-592274289',owner_user_name='tempest-VolumesAdminNegativeTest-592274289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f52da2ce49444c19eac225f85e7a157',uuid=e7d1898b-0b2e-4feb-9d06-48e20eb9e409,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converting VIF {"id": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "address": "fa:16:3e:8c:90:57", "network": {"id": "70d813d3-786f-4ded-8689-84b733c1c18e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-4223632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65cacd78e5db48399ddb0b666498b7af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98438a2e-6f", "ovs_interfaceid": "98438a2e-6f9b-4fe4-b0b8-216dc9a794bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:90:57,bridge_name='br-int',has_traffic_filtering=True,id=98438a2e-6f9b-4fe4-b0b8-216dc9a794bb,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98438a2e-6f') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG os_vif [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:90:57,bridge_name='br-int',has_traffic_filtering=True,id=98438a2e-6f9b-4fe4-b0b8-216dc9a794bb,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98438a2e-6f') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98438a2e-6f, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:41:42 user nova-compute[73029]: INFO os_vif [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:90:57,bridge_name='br-int',has_traffic_filtering=True,id=98438a2e-6f9b-4fe4-b0b8-216dc9a794bb,network=Network(70d813d3-786f-4ded-8689-84b733c1c18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98438a2e-6f')
Aug 10 00:41:42 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Deleting instance files /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409_del
Aug 10 00:41:42 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Deletion of /opt/stack/data/nova/instances/e7d1898b-0b2e-4feb-9d06-48e20eb9e409_del complete
Aug 10 00:41:42 user nova-compute[73029]: INFO nova.compute.manager [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 10 00:41:42 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:41:42 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:41:43 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:43 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Took 1.01 seconds to deallocate network for instance.
Aug 10 00:41:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-4e010435-2700-4919-a7c8-dcfb95e339cc req-6c77558b-5f32-41cf-ab6c-38be86723058 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received event network-vif-deleted-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:43 user nova-compute[73029]: INFO nova.compute.manager [req-4e010435-2700-4919-a7c8-dcfb95e339cc req-6c77558b-5f32-41cf-ab6c-38be86723058 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Neutron deleted interface 98438a2e-6f9b-4fe4-b0b8-216dc9a794bb; detaching it from the instance and deleting it from the info cache
Aug 10 00:41:43 user nova-compute[73029]: DEBUG nova.network.neutron [req-4e010435-2700-4919-a7c8-dcfb95e339cc req-6c77558b-5f32-41cf-ab6c-38be86723058 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-4e010435-2700-4919-a7c8-dcfb95e339cc req-6c77558b-5f32-41cf-ab6c-38be86723058 service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Detach interface failed, port_id=98438a2e-6f9b-4fe4-b0b8-216dc9a794bb, reason: Instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:41:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:44 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:41:44 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:41:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:44 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Deleted allocations for instance e7d1898b-0b2e-4feb-9d06-48e20eb9e409
Aug 10 00:41:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb4c0ea3-1f58-4f49-bd60-7b1036ceec5d tempest-VolumesAdminNegativeTest-592274289 tempest-VolumesAdminNegativeTest-592274289-project-member] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.625s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-e9941c24-da33-4666-98fb-5158d2ced98e req-3f8e5c74-2013-4579-95bf-356ddfa865ad service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received event network-vif-plugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e9941c24-da33-4666-98fb-5158d2ced98e req-3f8e5c74-2013-4579-95bf-356ddfa865ad service nova] Acquiring lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e9941c24-da33-4666-98fb-5158d2ced98e req-3f8e5c74-2013-4579-95bf-356ddfa865ad service nova] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e9941c24-da33-4666-98fb-5158d2ced98e req-3f8e5c74-2013-4579-95bf-356ddfa865ad service nova] Lock "e7d1898b-0b2e-4feb-9d06-48e20eb9e409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-e9941c24-da33-4666-98fb-5158d2ced98e req-3f8e5c74-2013-4579-95bf-356ddfa865ad service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] No waiting events found dispatching network-vif-plugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:44 user nova-compute[73029]: WARNING nova.compute.manager [req-e9941c24-da33-4666-98fb-5158d2ced98e req-3f8e5c74-2013-4579-95bf-356ddfa865ad service nova] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Received unexpected event network-vif-plugged-98438a2e-6f9b-4fe4-b0b8-216dc9a794bb for instance with vm_state deleted and task_state None.
Aug 10 00:41:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:50 user nova-compute[73029]: INFO nova.compute.manager [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Detaching volume 781b69f3-9c5f-461e-9a85-7812a66ef39c
Aug 10 00:41:50 user nova-compute[73029]: INFO nova.virt.block_device [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Attempting to driver detach volume 781b69f3-9c5f-461e-9a85-7812a66ef39c from mountpoint /dev/vdb
Aug 10 00:41:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Attempting to detach device vdb from instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:41:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:41:50 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:41:50 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:41:50 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:41:50 user nova-compute[73029]:   <serial>781b69f3-9c5f-461e-9a85-7812a66ef39c</serial>
Aug 10 00:41:50 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:41:50 user nova-compute[73029]: </disk>
Aug 10 00:41:50 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:41:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Successfully detached device vdb from instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 from the persistent domain config.
Aug 10 00:41:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:41:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:41:50 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:41:50 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:41:50 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:41:50 user nova-compute[73029]:   <serial>781b69f3-9c5f-461e-9a85-7812a66ef39c</serial>
Aug 10 00:41:50 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:41:50 user nova-compute[73029]: </disk>
Aug 10 00:41:50 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628111.0274212, 4a17123b-6ea8-450b-9ada-8c8278dcf739 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:41:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Successfully detached device vdb from instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 from the live domain config.
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXgpkLDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:41:51 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aea2c3-f171-4932-9549-da88b7c0be92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e456a7e-f6e1-41ba-b6e0-9515a428a18d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:41:51 user nova-compute[73029]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:41:51 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c (non-flash)
Aug 10 00:41:51 user nova-compute[73029]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:41:51 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141ce440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-ca2901b6-930c-477d-b270-66ffe0394899 req-574927ca-2d6c-4f04-ae84-104ee8c20820 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received event network-changed-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-ca2901b6-930c-477d-b270-66ffe0394899 req-574927ca-2d6c-4f04-ae84-104ee8c20820 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Refreshing instance network info cache due to event network-changed-9dfbbab5-a67c-4672-b965-328591564d2c. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ca2901b6-930c-477d-b270-66ffe0394899 req-574927ca-2d6c-4f04-ae84-104ee8c20820 service nova] Acquiring lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ca2901b6-930c-477d-b270-66ffe0394899 req-574927ca-2d6c-4f04-ae84-104ee8c20820 service nova] Acquired lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.network.neutron [req-ca2901b6-930c-477d-b270-66ffe0394899 req-574927ca-2d6c-4f04-ae84-104ee8c20820 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Refreshing network info cache for port 9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f16ede2-a9d9-4943-bcc0-535fae4df089]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb4e17-8057-464c-935a-2f1435c43b16]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae4b369-c50e-4202-b742-ace6bc190a7c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[69247195-34ec-4685-8ea4-8e15a273a094]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ededaa6a-d98a-4cc0-bc2a-7b808f0f83a4]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b47da9-e427-4f2b-a265-02792b69fb66]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c, portal: 172.16.0.220,3260]
Aug 10 00:41:51 user nova-compute[73029]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c, portal: 172.16.0.220,3260] successful.
Aug 10 00:41:51 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:781b69f3-9c5f-461e-9a85-7812a66ef39c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[68353cb3-b4cf-402c-ab54-7f3f9fcf0176]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] <== disconnect_volume: return (260ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.objects.instance [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lazy-loading 'flavor' on Instance uuid 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:51 user nova-compute[73029]: INFO nova.compute.manager [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Attaching volume 2a3f7401-3c0f-43a6-8719-12800b410a8e to /dev/vdb
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.network.neutron [req-ca2901b6-930c-477d-b270-66ffe0394899 req-574927ca-2d6c-4f04-ae84-104ee8c20820 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Updated VIF entry in instance network info cache for port 9dfbbab5-a67c-4672-b965-328591564d2c. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.network.neutron [req-ca2901b6-930c-477d-b270-66ffe0394899 req-574927ca-2d6c-4f04-ae84-104ee8c20820 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Updating instance_info_cache with network_info: [{"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ca2901b6-930c-477d-b270-66ffe0394899 req-574927ca-2d6c-4f04-ae84-104ee8c20820 service nova] Releasing lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.utils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5e10c2-58b4-460b-8e93-77cd9b847f58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e68327-89cb-4649-a26d-15e7120e664b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dc8b85-fd58-461e-86fe-6b3b40bdd4e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0837100e-7216-4a19-b3a2-fc4b7e4ccb21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:41:51 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:41:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc523eac-3408-463f-af40-57df4209f01e]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG os_brick.utils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:41:51 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Updating existing volume attachment record: 50514b2b-46bb-4694-b3b8-1005db0750e5 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'flavor' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 60e35a85-9268-4619-991d-05598abc314d {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 73d0b469-2ef5-4903-a9c3-8d658f0f058b {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "34141f58-5c62-4245-bd2a-06d4e4518529" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "60e35a85-9268-4619-991d-05598abc314d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "60e35a85-9268-4619-991d-05598abc314d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d377186b-c2c4-4e7d-a404-b350bcb1bb1a tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.801s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.016s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "34141f58-5c62-4245-bd2a-06d4e4518529" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "60e35a85-9268-4619-991d-05598abc314d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:54 user nova-compute[73029]: INFO nova.compute.manager [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Rescuing
Aug 10 00:41:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:41:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquired lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:41:54 user nova-compute[73029]: DEBUG nova.network.neutron [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG nova.network.neutron [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updating instance_info_cache with network_info: [{"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Releasing lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-da3f2581-25e1-435a-bbb2-32303a0ae5b5 req-42cf156e-1d44-4c3a-a0a8-d83ec5af8893 service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-unplugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-da3f2581-25e1-435a-bbb2-32303a0ae5b5 req-42cf156e-1d44-4c3a-a0a8-d83ec5af8893 service nova] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-da3f2581-25e1-435a-bbb2-32303a0ae5b5 req-42cf156e-1d44-4c3a-a0a8-d83ec5af8893 service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-da3f2581-25e1-435a-bbb2-32303a0ae5b5 req-42cf156e-1d44-4c3a-a0a8-d83ec5af8893 service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-da3f2581-25e1-435a-bbb2-32303a0ae5b5 req-42cf156e-1d44-4c3a-a0a8-d83ec5af8893 service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] No waiting events found dispatching network-vif-unplugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:55 user nova-compute[73029]: WARNING nova.compute.manager [req-da3f2581-25e1-435a-bbb2-32303a0ae5b5 req-42cf156e-1d44-4c3a-a0a8-d83ec5af8893 service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received unexpected event network-vif-unplugged-e5a3d05c-7b55-4c15-9928-da308650b378 for instance with vm_state active and task_state rescuing.
Aug 10 00:41:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Instance destroyed successfully.
Aug 10 00:41:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Attempting rescue
Aug 10 00:41:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73029) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Instance directory exists: not creating {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 10 00:41:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Creating image(s)
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG nova.objects.instance [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue" returned: 0 in 0.062s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.objects.instance [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'migration_context' on Instance uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Start _get_guest_xml network_info=[{"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "vif_mac": "fa:16:3e:ed:48:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.objects.instance [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'resources' on Instance uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.objects.instance [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'numa_topology' on Instance uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:56 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:56 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.objects.instance [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1615132056',display_name='tempest-ServerRescueNegativeTestJSON-server-1615132056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1615132056',id=17,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:40:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-tjlw8zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:13Z,user_data=None,user_id='4a4fb6b058c64442b1688a3962849322',uuid=34141f58-5c62-4245-bd2a-06d4e4518529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "vif_mac": "fa:16:3e:ed:48:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "vif_mac": "fa:16:3e:ed:48:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e5a3d05c-7b55-4c15-9928-da308650b378,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a3d05c-7b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.objects.instance [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'pci_devices' on Instance uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:41:56 user nova-compute[73029]:   <uuid>34141f58-5c62-4245-bd2a-06d4e4518529</uuid>
Aug 10 00:41:56 user nova-compute[73029]:   <name>instance-00000011</name>
Aug 10 00:41:56 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:41:56 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:41:56 user nova-compute[73029]:   <metadata>
Aug 10 00:41:56 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:41:56 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:41:56 user nova-compute[73029]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1615132056</nova:name>
Aug 10 00:41:56 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:41:56</nova:creationTime>
Aug 10 00:41:56 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:41:56 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:41:56 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:41:56 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:41:56 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:41:56 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:41:56 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:41:56 user nova-compute[73029]:       <nova:owner>
Aug 10 00:41:56 user nova-compute[73029]:         <nova:user uuid="4a4fb6b058c64442b1688a3962849322">tempest-ServerRescueNegativeTestJSON-1160585559-project-member</nova:user>
Aug 10 00:41:56 user nova-compute[73029]:         <nova:project uuid="e54d7ee7b2c741e2bbc4a1fb4a2cc042">tempest-ServerRescueNegativeTestJSON-1160585559</nova:project>
Aug 10 00:41:56 user nova-compute[73029]:       </nova:owner>
Aug 10 00:41:56 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:41:56 user nova-compute[73029]:       <nova:ports>
Aug 10 00:41:56 user nova-compute[73029]:         <nova:port uuid="e5a3d05c-7b55-4c15-9928-da308650b378">
Aug 10 00:41:56 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 10 00:41:56 user nova-compute[73029]:         </nova:port>
Aug 10 00:41:56 user nova-compute[73029]:       </nova:ports>
Aug 10 00:41:56 user nova-compute[73029]:     </nova:instance>
Aug 10 00:41:56 user nova-compute[73029]:   </metadata>
Aug 10 00:41:56 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:41:56 user nova-compute[73029]:     <system>
Aug 10 00:41:56 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:41:56 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:41:56 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:41:56 user nova-compute[73029]:       <entry name="serial">34141f58-5c62-4245-bd2a-06d4e4518529</entry>
Aug 10 00:41:56 user nova-compute[73029]:       <entry name="uuid">34141f58-5c62-4245-bd2a-06d4e4518529</entry>
Aug 10 00:41:56 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:41:56 user nova-compute[73029]:     </system>
Aug 10 00:41:56 user nova-compute[73029]:   </sysinfo>
Aug 10 00:41:56 user nova-compute[73029]:   <os>
Aug 10 00:41:56 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:41:56 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:41:56 user nova-compute[73029]:   </os>
Aug 10 00:41:56 user nova-compute[73029]:   <features>
Aug 10 00:41:56 user nova-compute[73029]:     <acpi/>
Aug 10 00:41:56 user nova-compute[73029]:     <apic/>
Aug 10 00:41:56 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:41:56 user nova-compute[73029]:   </features>
Aug 10 00:41:56 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:41:56 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:41:56 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:41:56 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:41:56 user nova-compute[73029]:   </clock>
Aug 10 00:41:56 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:41:56 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:41:56 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:41:56 user nova-compute[73029]:   </cpu>
Aug 10 00:41:56 user nova-compute[73029]:   <devices>
Aug 10 00:41:56 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:41:56 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:41:56 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue"/>
Aug 10 00:41:56 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:41:56 user nova-compute[73029]:     </disk>
Aug 10 00:41:56 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:41:56 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:41:56 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk"/>
Aug 10 00:41:56 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:41:56 user nova-compute[73029]:     </disk>
Aug 10 00:41:56 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:41:56 user nova-compute[73029]:       <mac address="fa:16:3e:ed:48:80"/>
Aug 10 00:41:56 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:41:56 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:41:56 user nova-compute[73029]:       <target dev="tape5a3d05c-7b"/>
Aug 10 00:41:56 user nova-compute[73029]:     </interface>
Aug 10 00:41:56 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:41:56 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/console.log" append="off"/>
Aug 10 00:41:56 user nova-compute[73029]:     </serial>
Aug 10 00:41:56 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:41:56 user nova-compute[73029]:     <video>
Aug 10 00:41:56 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:41:56 user nova-compute[73029]:     </video>
Aug 10 00:41:56 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:41:56 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:41:56 user nova-compute[73029]:     </rng>
Aug 10 00:41:56 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:41:56 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:41:56 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:41:56 user nova-compute[73029]:     </memballoon>
Aug 10 00:41:56 user nova-compute[73029]:   </devices>
Aug 10 00:41:56 user nova-compute[73029]: </domain>
Aug 10 00:41:56 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:41:56 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Instance destroyed successfully.
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:41:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No VIF found with MAC fa:16:3e:ed:48:80, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628102.6040509, e7d1898b-0b2e-4feb-9d06-48e20eb9e409 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:57 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] VM Stopped (Lifecycle Event)
Aug 10 00:41:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6a56862d-9966-4e72-b26f-6f07022bc3f1 None None] [instance: e7d1898b-0b2e-4feb-9d06-48e20eb9e409] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-ef7e058c-0963-4434-bad5-d40cc23e7362 req-e876076d-9da8-4c91-b108-c635aa69c25a service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ef7e058c-0963-4434-bad5-d40cc23e7362 req-e876076d-9da8-4c91-b108-c635aa69c25a service nova] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ef7e058c-0963-4434-bad5-d40cc23e7362 req-e876076d-9da8-4c91-b108-c635aa69c25a service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ef7e058c-0963-4434-bad5-d40cc23e7362 req-e876076d-9da8-4c91-b108-c635aa69c25a service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-ef7e058c-0963-4434-bad5-d40cc23e7362 req-e876076d-9da8-4c91-b108-c635aa69c25a service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] No waiting events found dispatching network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:57 user nova-compute[73029]: WARNING nova.compute.manager [req-ef7e058c-0963-4434-bad5-d40cc23e7362 req-e876076d-9da8-4c91-b108-c635aa69c25a service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received unexpected event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 for instance with vm_state active and task_state rescuing.
Aug 10 00:41:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] No waiting events found dispatching network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:59 user nova-compute[73029]: WARNING nova.compute.manager [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received unexpected event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 for instance with vm_state active and task_state rescuing.
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] No waiting events found dispatching network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:41:59 user nova-compute[73029]: WARNING nova.compute.manager [req-8c483a37-2afe-4e86-a2ca-101556262479 req-80622b74-d005-46db-9921-30e180fb92dd service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received unexpected event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 for instance with vm_state active and task_state rescuing.
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 34141f58-5c62-4245-bd2a-06d4e4518529 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628119.9133716, 34141f58-5c62-4245-bd2a-06d4e4518529 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:59 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] VM Resumed (Lifecycle Event)
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-43d84127-aefe-4b73-b196-aa3bdf323dd8 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:41:59 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628119.9148555, 34141f58-5c62-4245-bd2a-06d4e4518529 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:41:59 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] VM Started (Lifecycle Event)
Aug 10 00:41:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpVzXafm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:42:00 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:00 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:00 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5e2a80-2b38-48df-83db-5a977c311486]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:42:00 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be00d0e-b3b5-4de8-9ada-1752c0e99938]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e] added
Aug 10 00:42:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ec7e81-ecaa-4c58-9818-8ad4bd0b5bb2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdd1dd3-c305-4666-879c-a35fafe26e20]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpVzXafm {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpVzXafm" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d5fa0-4639-4ef6-9655-c4ac86045248]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RpVzXafm'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bc2f94-e280-419e-967c-32d3182895e8]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe4850a-3153-4c9b-b7c4-51ef892db848]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d866c-c18c-446b-a353-02a5f260a59b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260]
Aug 10 00:42:00 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260] successful.
Aug 10 00:42:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[76475bab-02b5-4501-bf85-f8f2eae1f593]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67de171-27bd-4fc8-a580-d5fc9ce78ef2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:01 user nova-compute[73029]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:01 user nova-compute[73029]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f19378-1807-4488-b723-1c88ff5c6f26]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpVzXafm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23766643966636261', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766643966636261', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG nova.objects.instance [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lazy-loading 'flavor' on Instance uuid 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:42:02 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:42:02 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:42:02 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:42:02 user nova-compute[73029]:   <serial>2a3f7401-3c0f-43a6-8719-12800b410a8e</serial>
Aug 10 00:42:02 user nova-compute[73029]: </disk>
Aug 10 00:42:02 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] No VIF found with MAC fa:16:3e:5a:28:f2, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-819382ae-e808-4b8f-9c8b-d5b1347c579f tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.106s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.544s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:03 user nova-compute[73029]: DEBUG os_brick.utils [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:42:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d07e14-050e-48df-8dc2-a1382e7a467d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30d9317-10c5-4e33-a54e-5a620d67f631]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7715afd-acc7-4c7b-ab70-cecda3fc5e26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ec7240-6588-4450-9a40-8b79a26bc210]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:42:04 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:42:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[720de2c8-cc3f-4859-af68-1cb1e0d04606]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:42:04 user nova-compute[73029]: DEBUG os_brick.utils [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:42:04 user nova-compute[73029]: INFO nova.compute.manager [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Swapping volume 2a3f7401-3c0f-43a6-8719-12800b410a8e for 349823aa-e958-4590-81d8-bec04dcdba83
Aug 10 00:42:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sriPujOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e356ed0-276c-4a27-9294-3176cc022c18', 'attached_at': '', 'detached_at': '', 'volume_id': '349823aa-e958-4590-81d8-bec04dcdba83', 'serial': '349823aa-e958-4590-81d8-bec04dcdba83'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpVzXafm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5e356ed0-276c-4a27-9294-3176cc022c18', 'attached_at': '', 'detached_at': '', 'volume_id': '2a3f7401-3c0f-43a6-8719-12800b410a8e', 'serial'} {{(pid=73029) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sriPujOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:42:12 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:12 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:12 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3b7a69-9f43-429b-b9c8-da2b82120d31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:42:12 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61cf963-fc60-46e8-8f0e-9d813bb7af80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83] added
Aug 10 00:42:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e786076-a63f-4a63-996c-f209fd5cbc80]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[98993bf9-2ee5-444b-94d2-8ec5b5e83554]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sriPujOI {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating instance_info_cache with network_info: [{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sriPujOI" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8149e06-69e4-4f89-b709-4da94fad3fc3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sriPujOI'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dffb89-d731-427c-93c2-b2e5c809ff5a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da973a2-2910-4320-b03e-6505fd653ebd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:12 user nova-compute[73029]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:12 user nova-compute[73029]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9100f8-87fb-43c8-9b28-f2512926c55f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83, portal: 172.16.0.220,3260]
Aug 10 00:42:12 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83, portal: 172.16.0.220,3260] successful.
Aug 10 00:42:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19566be-c36e-4bc2-b6ad-a6be6f7aac1f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d141d1-be34-4f15-9a84-6d5a601a11a7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:12 user nova-compute[73029]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:12 user nova-compute[73029]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:12 user nova-compute[73029]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:12 user nova-compute[73029]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cff6acf-8064-495c-92c7-323d031a015f]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:42:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sriPujOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:42:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23061613438313334', 'path': '/dev/sdd'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:42:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061613438313334', 'path': '/dev/sdd'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:42:13 user nova-compute[73029]: DEBUG nova.objects.instance [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lazy-loading 'flavor' on Instance uuid 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:42:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 145752064 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 334495744 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:42:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:42:15 user nova-compute[73029]: INFO nova.compute.claims [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Claim successful on node user
Aug 10 00:42:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 520093696 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 708837376 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:42:16 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.policy [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad4b1f5525d54f399db688f2ff7f0752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ec174542da4ef6ac5751fb12c9f808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:42:16 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Creating image(s)
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "/opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "/opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "/opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.169s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 884998144 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.172s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk 1073741824" returned: 0 in 0.073s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.187s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 1054867456 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Successfully created port: ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Cannot resize image /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'migration_context' on Instance uuid 889d1049-c384-4ad3-837c-4c739f345e1c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Ensure instance console log exists: /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpVzXafm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:42:18 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bdd3e5-949c-4cdb-a41f-ac359628e0cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb98d0ec-bfc8-458d-b880-e1a74db68d3a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:18 user nova-compute[73029]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:18 user nova-compute[73029]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:18 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:18 user nova-compute[73029]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:18 user nova-compute[73029]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:18 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7514191fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Successfully updated port: ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da4abee-5926-48f4-ac32-81f40fd3686b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "refresh_cache-889d1049-c384-4ad3-837c-4c739f345e1c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquired lock "refresh_cache-889d1049-c384-4ad3-837c-4c739f345e1c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e371fc7-adc7-4dca-8aae-7919a31d50be]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-ae2f532c-3d17-464f-b715-39779c73960b req-0a50eea6-225b-4fc8-a4ea-94afb56b3bf0 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received event network-changed-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-ae2f532c-3d17-464f-b715-39779c73960b req-0a50eea6-225b-4fc8-a4ea-94afb56b3bf0 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Refreshing instance network info cache due to event network-changed-ebba57ea-ef60-4d81-84a0-91ed11028df9. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ae2f532c-3d17-464f-b715-39779c73960b req-0a50eea6-225b-4fc8-a4ea-94afb56b3bf0 service nova] Acquiring lock "refresh_cache-889d1049-c384-4ad3-837c-4c739f345e1c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1828b22-672d-4f90-96a4-5484be04be25]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7519cb-5176-4254-b633-1ab5824e0851]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1573f9-e498-4014-96bb-23dc035d550c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b38e2c-2071-4929-94c6-bebaa81e0b7e]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260]
Aug 10 00:42:18 user nova-compute[73029]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260] successful.
Aug 10 00:42:18 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d5a47f-9909-448b-8bc1-a31258386e50]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] <== disconnect_volume: return (285ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sriPujOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5e356ed0-276c-4a27-9294-3176cc022c18', 'attached_at': '', 'detached_at': '', 'volume_id': '349823aa-e958-4590-81d8-bec04dcdba83', 'serial'} {{(pid=73029) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] swap_volume: removing Cinder connection for volume 2a3f7401-3c0f-43a6-8719-12800b410a8e {{(pid=73029) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Updating instance_info_cache with network_info: [{"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Releasing lock "refresh_cache-889d1049-c384-4ad3-837c-4c739f345e1c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Instance network_info: |[{"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ae2f532c-3d17-464f-b715-39779c73960b req-0a50eea6-225b-4fc8-a4ea-94afb56b3bf0 service nova] Acquired lock "refresh_cache-889d1049-c384-4ad3-837c-4c739f345e1c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.network.neutron [req-ae2f532c-3d17-464f-b715-39779c73960b req-0a50eea6-225b-4fc8-a4ea-94afb56b3bf0 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Refreshing network info cache for port ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Start _get_guest_xml network_info=[{"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:42:18 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:42:18 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-351120651',display_name='tempest-AttachVolumeNegativeTest-server-351120651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-351120651',id=22,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX39A1rScYkmK88fixCMJm1+ctq1nv/6LW9e+3n7GZWkpRDIt93Zl2UFkQVtH7mtGe1hCmLiGn3Ndqe0cjddxgV04q4ArddRXErtpjUnRtRwz8dTpuQqHqij0HmIFQiCA==',key_name='tempest-keypair-1598194538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-n2i05e0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=889d1049-c384-4ad3-837c-4c739f345e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:02,bridge_name='br-int',has_traffic_filtering=True,id=ebba57ea-ef60-4d81-84a0-91ed11028df9,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebba57ea-ef') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'pci_devices' on Instance uuid 889d1049-c384-4ad3-837c-4c739f345e1c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:42:18 user nova-compute[73029]:   <uuid>889d1049-c384-4ad3-837c-4c739f345e1c</uuid>
Aug 10 00:42:18 user nova-compute[73029]:   <name>instance-00000016</name>
Aug 10 00:42:18 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:42:18 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:42:18 user nova-compute[73029]:   <metadata>
Aug 10 00:42:18 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:42:18 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:42:18 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeNegativeTest-server-351120651</nova:name>
Aug 10 00:42:18 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:42:18</nova:creationTime>
Aug 10 00:42:18 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:42:18 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:42:18 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:42:18 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:42:18 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:42:18 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:42:18 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:42:18 user nova-compute[73029]:       <nova:owner>
Aug 10 00:42:18 user nova-compute[73029]:         <nova:user uuid="ad4b1f5525d54f399db688f2ff7f0752">tempest-AttachVolumeNegativeTest-685145765-project-member</nova:user>
Aug 10 00:42:18 user nova-compute[73029]:         <nova:project uuid="22ec174542da4ef6ac5751fb12c9f808">tempest-AttachVolumeNegativeTest-685145765</nova:project>
Aug 10 00:42:18 user nova-compute[73029]:       </nova:owner>
Aug 10 00:42:18 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:42:18 user nova-compute[73029]:       <nova:ports>
Aug 10 00:42:18 user nova-compute[73029]:         <nova:port uuid="ebba57ea-ef60-4d81-84a0-91ed11028df9">
Aug 10 00:42:18 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 00:42:18 user nova-compute[73029]:         </nova:port>
Aug 10 00:42:18 user nova-compute[73029]:       </nova:ports>
Aug 10 00:42:18 user nova-compute[73029]:     </nova:instance>
Aug 10 00:42:18 user nova-compute[73029]:   </metadata>
Aug 10 00:42:18 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:42:18 user nova-compute[73029]:     <system>
Aug 10 00:42:18 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:42:18 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:42:18 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:42:18 user nova-compute[73029]:       <entry name="serial">889d1049-c384-4ad3-837c-4c739f345e1c</entry>
Aug 10 00:42:18 user nova-compute[73029]:       <entry name="uuid">889d1049-c384-4ad3-837c-4c739f345e1c</entry>
Aug 10 00:42:18 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:42:18 user nova-compute[73029]:     </system>
Aug 10 00:42:18 user nova-compute[73029]:   </sysinfo>
Aug 10 00:42:18 user nova-compute[73029]:   <os>
Aug 10 00:42:18 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:42:18 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:42:18 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:42:18 user nova-compute[73029]:   </os>
Aug 10 00:42:18 user nova-compute[73029]:   <features>
Aug 10 00:42:18 user nova-compute[73029]:     <acpi/>
Aug 10 00:42:18 user nova-compute[73029]:     <apic/>
Aug 10 00:42:18 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:42:18 user nova-compute[73029]:   </features>
Aug 10 00:42:18 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:42:18 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:42:18 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:42:18 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:42:18 user nova-compute[73029]:   </clock>
Aug 10 00:42:18 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:42:18 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:42:18 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:42:18 user nova-compute[73029]:   </cpu>
Aug 10 00:42:18 user nova-compute[73029]:   <devices>
Aug 10 00:42:18 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:42:18 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:42:18 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk"/>
Aug 10 00:42:18 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:42:18 user nova-compute[73029]:     </disk>
Aug 10 00:42:18 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:42:18 user nova-compute[73029]:       <mac address="fa:16:3e:22:31:02"/>
Aug 10 00:42:18 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:42:18 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:42:18 user nova-compute[73029]:       <target dev="tapebba57ea-ef"/>
Aug 10 00:42:18 user nova-compute[73029]:     </interface>
Aug 10 00:42:18 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:42:18 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/console.log" append="off"/>
Aug 10 00:42:18 user nova-compute[73029]:     </serial>
Aug 10 00:42:18 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:42:18 user nova-compute[73029]:     <video>
Aug 10 00:42:18 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:42:18 user nova-compute[73029]:     </video>
Aug 10 00:42:18 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:42:18 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:42:18 user nova-compute[73029]:     </rng>
Aug 10 00:42:18 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:42:18 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:42:18 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:42:18 user nova-compute[73029]:     </memballoon>
Aug 10 00:42:18 user nova-compute[73029]:   </devices>
Aug 10 00:42:18 user nova-compute[73029]: </domain>
Aug 10 00:42:18 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-351120651',display_name='tempest-AttachVolumeNegativeTest-server-351120651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-351120651',id=22,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX39A1rScYkmK88fixCMJm1+ctq1nv/6LW9e+3n7GZWkpRDIt93Zl2UFkQVtH7mtGe1hCmLiGn3Ndqe0cjddxgV04q4ArddRXErtpjUnRtRwz8dTpuQqHqij0HmIFQiCA==',key_name='tempest-keypair-1598194538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-n2i05e0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=889d1049-c384-4ad3-837c-4c739f345e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:02,bridge_name='br-int',has_traffic_filtering=True,id=ebba57ea-ef60-4d81-84a0-91ed11028df9,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebba57ea-ef') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG os_vif [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:02,bridge_name='br-int',has_traffic_filtering=True,id=ebba57ea-ef60-4d81-84a0-91ed11028df9,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebba57ea-ef') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebba57ea-ef, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebba57ea-ef, col_values=(('external_ids', {'iface-id': 'ebba57ea-ef60-4d81-84a0-91ed11028df9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:31:02', 'vm-uuid': '889d1049-c384-4ad3-837c-4c739f345e1c'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:18 user nova-compute[73029]: INFO os_vif [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:02,bridge_name='br-int',has_traffic_filtering=True,id=ebba57ea-ef60-4d81-84a0-91ed11028df9,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebba57ea-ef')
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:42:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No VIF found with MAC fa:16:3e:22:31:02, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:42:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-ae2f532c-3d17-464f-b715-39779c73960b req-0a50eea6-225b-4fc8-a4ea-94afb56b3bf0 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Updated VIF entry in instance network info cache for port ebba57ea-ef60-4d81-84a0-91ed11028df9. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:42:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-ae2f532c-3d17-464f-b715-39779c73960b req-0a50eea6-225b-4fc8-a4ea-94afb56b3bf0 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Updating instance_info_cache with network_info: [{"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:42:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ae2f532c-3d17-464f-b715-39779c73960b req-0a50eea6-225b-4fc8-a4ea-94afb56b3bf0 service nova] Releasing lock "refresh_cache-889d1049-c384-4ad3-837c-4c739f345e1c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:42:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:42:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] swap_volume: Updating volume 2a3f7401-3c0f-43a6-8719-12800b410a8e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "sriPujOI", "auth_password": "ytPeQjdLa1oRYh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "349823aa-e958-4590-81d8-bec04dcdba83"}, "status": "reserved", "instance": "5e356ed0-276c-4a27-9294-3176cc022c18", "attached_at": "", "detached_at": "", "volume_id": "349823aa-e958-4590-81d8-bec04dcdba83", "serial": "349823aa-e958-4590-81d8-bec04dcdba83"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '349823aa-e958-4590-81d8-bec04dcdba83', 'no_device': None, 'attachment_id': 'a04ee6ba-2cf6-4e41-bf90-8f93ce76d830'} {{(pid=73029) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 10 00:42:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6ff5649f-efa0-4fde-bcb3-b6739f29e86c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.288s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-e5d7001b-5e44-4d33-8c67-5117a1614ad6 req-6387ded5-c037-46e4-aa1c-6df2a70b05a2 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received event network-vif-plugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e5d7001b-5e44-4d33-8c67-5117a1614ad6 req-6387ded5-c037-46e4-aa1c-6df2a70b05a2 service nova] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e5d7001b-5e44-4d33-8c67-5117a1614ad6 req-6387ded5-c037-46e4-aa1c-6df2a70b05a2 service nova] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e5d7001b-5e44-4d33-8c67-5117a1614ad6 req-6387ded5-c037-46e4-aa1c-6df2a70b05a2 service nova] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-e5d7001b-5e44-4d33-8c67-5117a1614ad6 req-6387ded5-c037-46e4-aa1c-6df2a70b05a2 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] No waiting events found dispatching network-vif-plugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:42:20 user nova-compute[73029]: WARNING nova.compute.manager [req-e5d7001b-5e44-4d33-8c67-5117a1614ad6 req-6387ded5-c037-46e4-aa1c-6df2a70b05a2 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received unexpected event network-vif-plugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 for instance with vm_state building and task_state spawning.
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG os_brick.utils [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf4a23a-9d48-479c-b686-fa2d3b5425e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb7c55a-4fc3-45c8-8945-5c43d99cab99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e443217c-9d69-4e77-bcb6-0a80998e9b7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c93fbe2-b41f-4f4b-a9b3-440761edab29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:42:20 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[57978f98-5e8b-42be-966d-02989abb72ed]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG os_brick.utils [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:20 user nova-compute[73029]: INFO nova.compute.manager [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Swapping volume 349823aa-e958-4590-81d8-bec04dcdba83 for 2a3f7401-3c0f-43a6-8719-12800b410a8e
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "60e35a85-9268-4619-991d-05598abc314d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "60e35a85-9268-4619-991d-05598abc314d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "60e35a85-9268-4619-991d-05598abc314d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "60e35a85-9268-4619-991d-05598abc314d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "60e35a85-9268-4619-991d-05598abc314d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:21 user nova-compute[73029]: INFO nova.compute.manager [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Terminating instance
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-03cdd5b5-b34f-4729-8a68-abf3f7dd89e8 req-2b7c97d7-7dad-423a-8957-e524cc165e84 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received event network-vif-unplugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-03cdd5b5-b34f-4729-8a68-abf3f7dd89e8 req-2b7c97d7-7dad-423a-8957-e524cc165e84 service nova] Acquiring lock "60e35a85-9268-4619-991d-05598abc314d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-03cdd5b5-b34f-4729-8a68-abf3f7dd89e8 req-2b7c97d7-7dad-423a-8957-e524cc165e84 service nova] Lock "60e35a85-9268-4619-991d-05598abc314d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-03cdd5b5-b34f-4729-8a68-abf3f7dd89e8 req-2b7c97d7-7dad-423a-8957-e524cc165e84 service nova] Lock "60e35a85-9268-4619-991d-05598abc314d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-03cdd5b5-b34f-4729-8a68-abf3f7dd89e8 req-2b7c97d7-7dad-423a-8957-e524cc165e84 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] No waiting events found dispatching network-vif-unplugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-03cdd5b5-b34f-4729-8a68-abf3f7dd89e8 req-2b7c97d7-7dad-423a-8957-e524cc165e84 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received event network-vif-unplugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 60e35a85-9268-4619-991d-05598abc314d] Instance destroyed successfully.
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lazy-loading 'resources' on Instance uuid 60e35a85-9268-4619-991d-05598abc314d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-131635809',display_name='tempest-VolumesActionsTest-instance-131635809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-131635809',id=18,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db8d6b005e844e3b1232942bf67fb9a',ramdisk_id='',reservation_id='r-013v6zj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-261338927',owner_user_name='tempest-VolumesActionsTest-261338927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:40:39Z,user_data=None,user_id='9c16b4b3e2e34e5e9e53dcfaf4b948dd',uuid=60e35a85-9268-4619-991d-05598abc314d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converting VIF {"id": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "address": "fa:16:3e:89:6d:19", "network": {"id": "f07f1797-e703-4308-927d-03363d8cfbdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2047633045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8d6b005e844e3b1232942bf67fb9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b494a1-ef", "ovs_interfaceid": "e1b494a1-efb5-4c93-8631-67cf16d4c9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=e1b494a1-efb5-4c93-8631-67cf16d4c9d5,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b494a1-ef') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG os_vif [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=e1b494a1-efb5-4c93-8631-67cf16d4c9d5,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b494a1-ef') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1b494a1-ef, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:42:21 user nova-compute[73029]: INFO os_vif [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=e1b494a1-efb5-4c93-8631-67cf16d4c9d5,network=Network(f07f1797-e703-4308-927d-03363d8cfbdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b494a1-ef')
Aug 10 00:42:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Deleting instance files /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d_del
Aug 10 00:42:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Deletion of /opt/stack/data/nova/instances/60e35a85-9268-4619-991d-05598abc314d_del complete
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:21 user nova-compute[73029]: INFO nova.compute.manager [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] [instance: 60e35a85-9268-4619-991d-05598abc314d] Took 0.78 seconds to destroy the instance on the hypervisor.
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 60e35a85-9268-4619-991d-05598abc314d] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 60e35a85-9268-4619-991d-05598abc314d] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.compute.manager [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Detaching volume 85bd054b-8da1-42f8-b7b5-404ba7974bc5
Aug 10 00:42:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.virt.block_device [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Attempting to driver detach volume 85bd054b-8da1-42f8-b7b5-404ba7974bc5 from mountpoint /dev/vdb
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Attempting to detach device vdb from instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:42:22 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:42:22 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 00:42:22 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:42:22 user nova-compute[73029]:   <serial>85bd054b-8da1-42f8-b7b5-404ba7974bc5</serial>
Aug 10 00:42:22 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 10 00:42:22 user nova-compute[73029]: </disk>
Aug 10 00:42:22 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628142.2110696, 889d1049-c384-4ad3-837c-4c739f345e1c => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] VM Resumed (Lifecycle Event)
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully detached device vdb from instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f from the persistent domain config.
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:42:22 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:42:22 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 00:42:22 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:42:22 user nova-compute[73029]:   <serial>85bd054b-8da1-42f8-b7b5-404ba7974bc5</serial>
Aug 10 00:42:22 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 10 00:42:22 user nova-compute[73029]: </disk>
Aug 10 00:42:22 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Instance spawned successfully.
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628142.2113705, 889d1049-c384-4ad3-837c-4c739f345e1c => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] VM Started (Lifecycle Event)
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-44bd6f7b-ce93-4e39-908b-205f825a0a6f req-fa7e9fbd-2ca7-4c0d-99ad-ed10f0f16f98 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received event network-vif-plugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-44bd6f7b-ce93-4e39-908b-205f825a0a6f req-fa7e9fbd-2ca7-4c0d-99ad-ed10f0f16f98 service nova] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-44bd6f7b-ce93-4e39-908b-205f825a0a6f req-fa7e9fbd-2ca7-4c0d-99ad-ed10f0f16f98 service nova] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-44bd6f7b-ce93-4e39-908b-205f825a0a6f req-fa7e9fbd-2ca7-4c0d-99ad-ed10f0f16f98 service nova] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-44bd6f7b-ce93-4e39-908b-205f825a0a6f req-fa7e9fbd-2ca7-4c0d-99ad-ed10f0f16f98 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] No waiting events found dispatching network-vif-plugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:42:22 user nova-compute[73029]: WARNING nova.compute.manager [req-44bd6f7b-ce93-4e39-908b-205f825a0a6f req-fa7e9fbd-2ca7-4c0d-99ad-ed10f0f16f98 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received unexpected event network-vif-plugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 for instance with vm_state building and task_state spawning.
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 60e35a85-9268-4619-991d-05598abc314d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 60e35a85-9268-4619-991d-05598abc314d] Took 0.65 seconds to deallocate network for instance.
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.compute.manager [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Took 6.95 seconds to build instance.
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8246d2f9-3420-4143-9868-9720692b6580 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.131s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628142.8222253, ee3b2f60-0756-4d77-97ac-11fa0c456c1f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:42:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully detached device vdb from instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f from the live domain config.
Aug 10 00:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXucSwLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:42:22 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9249cfda-3e29-4a35-b8ec-b83eef29354c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[858b856a-61ac-4de8-9c1b-4dfb22529fa9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:22 user nova-compute[73029]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 (non-flash)
Aug 10 00:42:22 user nova-compute[73029]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751411bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[477383a8-1c38-45b0-a6e1-db16c7ee8c4c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[236547d1-990e-4936-ab8b-209586fd6309]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c1d9f2-baf0-443d-8702-716993a92abe]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd279373-5775-4a03-947b-fba2d16293bf]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[28231a6c-4dcc-4102-bd74-280d28e2813e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ed010b-9a8d-41ae-a8f9-a06ad4d503b3]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260]
Aug 10 00:42:23 user nova-compute[73029]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5, portal: 172.16.0.220,3260] successful.
Aug 10 00:42:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bd054b-8da1-42f8-b7b5-404ba7974bc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1554fbfa-fd52-4e84-b5d7-65da388f45c4]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== disconnect_volume: return (362ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.709s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:23 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Deleted allocations for instance 60e35a85-9268-4619-991d-05598abc314d
Aug 10 00:42:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-4d8edf7f-b924-4264-8f8d-b8dfb8a1de6e req-a76468b6-daa5-4248-9821-7ccc648e7999 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received event network-vif-plugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d8edf7f-b924-4264-8f8d-b8dfb8a1de6e req-a76468b6-daa5-4248-9821-7ccc648e7999 service nova] Acquiring lock "60e35a85-9268-4619-991d-05598abc314d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d8edf7f-b924-4264-8f8d-b8dfb8a1de6e req-a76468b6-daa5-4248-9821-7ccc648e7999 service nova] Lock "60e35a85-9268-4619-991d-05598abc314d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4d8edf7f-b924-4264-8f8d-b8dfb8a1de6e req-a76468b6-daa5-4248-9821-7ccc648e7999 service nova] Lock "60e35a85-9268-4619-991d-05598abc314d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-4d8edf7f-b924-4264-8f8d-b8dfb8a1de6e req-a76468b6-daa5-4248-9821-7ccc648e7999 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] No waiting events found dispatching network-vif-plugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:42:23 user nova-compute[73029]: WARNING nova.compute.manager [req-4d8edf7f-b924-4264-8f8d-b8dfb8a1de6e req-a76468b6-daa5-4248-9821-7ccc648e7999 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received unexpected event network-vif-plugged-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 for instance with vm_state deleted and task_state None.
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e85758d7-41d5-477c-a27c-9a48d4add716 tempest-VolumesActionsTest-261338927 tempest-VolumesActionsTest-261338927-project-member] Lock "60e35a85-9268-4619-991d-05598abc314d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.423s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.objects.instance [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'flavor' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-28776033-8d8a-4ef0-9a42-99140afd2130 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.186s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-5a1c3507-ac46-42db-96e8-958d4443acd0 req-9750cfea-fc8e-46e3-b86b-ab0fa56d72a5 service nova] [instance: 60e35a85-9268-4619-991d-05598abc314d] Received event network-vif-deleted-e1b494a1-efb5-4c93-8631-67cf16d4c9d5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:24 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:42:24 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7151MB free_disk=25.1790771484375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 4a17123b-6ea8-450b-9ada-8c8278dcf739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 5e356ed0-276c-4a27-9294-3176cc022c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 73d0b469-2ef5-4903-a9c3-8d658f0f058b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 889d1049-c384-4ad3-837c-4c739f345e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:42:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:42:25 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:42:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:42:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:42:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpVzXafm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e356ed0-276c-4a27-9294-3176cc022c18', 'attached_at': '', 'detached_at': '', 'volume_id': '2a3f7401-3c0f-43a6-8719-12800b410a8e', 'serial': '2a3f7401-3c0f-43a6-8719-12800b410a8e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sriPujOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '349823aa-e958-4590-81d8-bec04dcdba83'}, 'status': 'reserved', 'instance': '5e356ed0-276c-4a27-9294-3176cc022c18', 'attached_at': '', 'detached_at': '', 'volume_id': '349823aa-e958-4590-81d8-bec04dcdba83', 'serial'} {{(pid=73029) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpVzXafm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:42:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:29 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8758477-b6b2-44c4-b905-1b2c08ab5181]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:42:29 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[122bc147-0c69-4283-86a3-0638939de94d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e] added
Aug 10 00:42:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5425496b-1569-48c6-9981-6242123a25c6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe9b4ec-6c80-4d09-b66b-213bad367b3f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpVzXafm {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpVzXafm" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fcf001-9fe7-4c1b-ae1e-27367a6b8344]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RpVzXafm'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6291f1f9-942b-4c2a-80d5-19aba2e2f581]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1705f3a8-d03d-4ec1-b1d5-f308f26f9e2f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c9c7fd-027f-497d-a296-87ebb1312aed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260]
Aug 10 00:42:29 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260] successful.
Aug 10 00:42:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[149ddeff-05e5-45bb-862c-5c459469a0d2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dbd8c6-0f02-49a7-9042-e3197dd73f17]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:29 user nova-compute[73029]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:29 user nova-compute[73029]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:42:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d5cbf7-cd91-462a-98d7-98c9b6b8e1cd]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:42:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpVzXafm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:42:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23766643966636261', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:42:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766643966636261', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:42:31 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lazy-loading 'flavor' on Instance uuid 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 361758720 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 554696704 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 722468864 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 893386752 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 1062207488 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sriPujOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '349823aa-e958-4590-81d8-bec04dcdba83'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:42:35 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d55ec1-4069-4c66-a578-1b47d7361e78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8684316-396a-4a0c-8fc3-a17e6f168fc7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:35 user nova-compute[73029]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:35 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 (non-flash)
Aug 10 00:42:35 user nova-compute[73029]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:35 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75147681f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83'): ({'sdd'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Removing single pathed devices sdd {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3911c8d2-b7c8-4991-b36b-de62eb12ef1c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[437d84f3-8070-48f8-a600-d4cf776fa179]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Flushing IO for device /dev/sdd {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb17ca8-4545-4e86-8c90-61423380890d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e46255-cb40-47e1-a09a-70b5be83f775]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.086s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b103b28-a729-47ed-acb7-bdf4b87c361f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc777e75-69bb-4fd6-9f0c-300c260e0e52]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83, portal: 172.16.0.220,3260]
Aug 10 00:42:35 user nova-compute[73029]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83, portal: 172.16.0.220,3260] successful.
Aug 10 00:42:35 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349823aa-e958-4590-81d8-bec04dcdba83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c01c5-ae52-49c1-b078-82575279449b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] <== disconnect_volume: return (341ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpVzXafm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5e356ed0-276c-4a27-9294-3176cc022c18', 'attached_at': '', 'detached_at': '', 'volume_id': '2a3f7401-3c0f-43a6-8719-12800b410a8e', 'serial'} {{(pid=73029) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 10 00:42:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] swap_volume: removing Cinder connection for volume 349823aa-e958-4590-81d8-bec04dcdba83 {{(pid=73029) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 10 00:42:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] swap_volume: Updating volume 349823aa-e958-4590-81d8-bec04dcdba83 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "RpVzXafm", "auth_password": "6LD8He7ali5TOI", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "2a3f7401-3c0f-43a6-8719-12800b410a8e"}, "status": "reserved", "instance": "5e356ed0-276c-4a27-9294-3176cc022c18", "attached_at": "", "detached_at": "", "volume_id": "2a3f7401-3c0f-43a6-8719-12800b410a8e", "serial": "2a3f7401-3c0f-43a6-8719-12800b410a8e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2a3f7401-3c0f-43a6-8719-12800b410a8e', 'no_device': None, 'attachment_id': '2db028e1-0f33-4295-8277-c7f86a680306'} {{(pid=73029) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 10 00:42:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5725b18b-9792-4c00-a177-12c0c62a547c tempest-TestVolumeSwap-1252697430 tempest-TestVolumeSwap-1252697430-project-admin] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.640s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:36 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628141.7145867, 60e35a85-9268-4619-991d-05598abc314d => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:42:36 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 60e35a85-9268-4619-991d-05598abc314d] VM Stopped (Lifecycle Event)
Aug 10 00:42:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c983f35d-6fc4-48af-9489-cd810d1d62c4 None None] [instance: 60e35a85-9268-4619-991d-05598abc314d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:42:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:37 user nova-compute[73029]: INFO nova.compute.manager [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Detaching volume 2a3f7401-3c0f-43a6-8719-12800b410a8e
Aug 10 00:42:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:37 user nova-compute[73029]: INFO nova.virt.block_device [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Attempting to driver detach volume 2a3f7401-3c0f-43a6-8719-12800b410a8e from mountpoint /dev/vdb
Aug 10 00:42:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Attempting to detach device vdb from instance 5e356ed0-276c-4a27-9294-3176cc022c18 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:42:37 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:42:37 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:42:37 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:42:37 user nova-compute[73029]:   <serial>2a3f7401-3c0f-43a6-8719-12800b410a8e</serial>
Aug 10 00:42:37 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:42:37 user nova-compute[73029]: </disk>
Aug 10 00:42:37 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:42:37 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Successfully detached device vdb from instance 5e356ed0-276c-4a27-9294-3176cc022c18 from the persistent domain config.
Aug 10 00:42:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e356ed0-276c-4a27-9294-3176cc022c18 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:42:37 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:42:37 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:42:37 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:42:37 user nova-compute[73029]:   <serial>2a3f7401-3c0f-43a6-8719-12800b410a8e</serial>
Aug 10 00:42:37 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:42:37 user nova-compute[73029]: </disk>
Aug 10 00:42:37 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628157.6302001, 5e356ed0-276c-4a27-9294-3176cc022c18 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:42:37 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Successfully detached device vdb from instance 5e356ed0-276c-4a27-9294-3176cc022c18 from the live domain config.
Aug 10 00:42:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpVzXafm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '2a3f7401-3c0f-43a6-8719-12800b410a8e'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:42:37 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2f97dc-3c3a-4398-8d33-a8c673604fa5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dea066-5635-4dc3-8ab7-2a4201eed6b6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:37 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e (non-flash)
Aug 10 00:42:37 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751d96e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a187a8b-4c93-4fef-a670-ea812bed4548]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e7900b-1f50-491e-9ef2-b5fb0efdb0ff]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f39fc1-74a2-4bc7-83cc-fe12b4700bfe]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8ca0a6-73f2-4fbe-a140-7bdc36fe75eb]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7feb3d-4bfb-4af2-8d6f-2f05ee3a10b4]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[556443df-fbf6-48f0-9f9a-3ab9f3dfac33]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260]
Aug 10 00:42:37 user nova-compute[73029]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e, portal: 172.16.0.220,3260] successful.
Aug 10 00:42:37 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3f7401-3c0f-43a6-8719-12800b410a8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ed393a-5e86-4e9b-81f0-f44aec6d1cfa]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] <== disconnect_volume: return (269ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:42:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:42:38 user nova-compute[73029]: DEBUG nova.objects.instance [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lazy-loading 'flavor' on Instance uuid 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-12470cee-576e-4a3a-b590-ae2b21aeef63 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.575s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:41 user nova-compute[73029]: INFO nova.compute.manager [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Terminating instance
Aug 10 00:42:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-ab935fcc-c9a6-4ef6-8f7c-11fe4f6476a0 req-7bbf7569-a21c-4cc8-84c5-13dcbaee81ef service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-unplugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ab935fcc-c9a6-4ef6-8f7c-11fe4f6476a0 req-7bbf7569-a21c-4cc8-84c5-13dcbaee81ef service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ab935fcc-c9a6-4ef6-8f7c-11fe4f6476a0 req-7bbf7569-a21c-4cc8-84c5-13dcbaee81ef service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ab935fcc-c9a6-4ef6-8f7c-11fe4f6476a0 req-7bbf7569-a21c-4cc8-84c5-13dcbaee81ef service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-ab935fcc-c9a6-4ef6-8f7c-11fe4f6476a0 req-7bbf7569-a21c-4cc8-84c5-13dcbaee81ef service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-unplugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-ab935fcc-c9a6-4ef6-8f7c-11fe4f6476a0 req-7bbf7569-a21c-4cc8-84c5-13dcbaee81ef service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-unplugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Instance destroyed successfully.
Aug 10 00:42:41 user nova-compute[73029]: DEBUG nova.objects.instance [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lazy-loading 'resources' on Instance uuid 4a17123b-6ea8-450b-9ada-8c8278dcf739 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-691660506',display_name='tempest-ServerStableDeviceRescueTest-server-691660506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-691660506',id=3,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2qMclUiDDtfdBQQEFJIJT7zei+fvBSFEd1IVsKrxuITgVneSkV8lM0t15+OyE3mgphGmJcPu/oAK76jlQjN7i12XxfI3xmn+chXoTRAs6YW2/irdffyhbV6xNXZ7tXIA==',key_name='tempest-keypair-1474595581',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:39:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='475e002776ae4e2e994cc801872bcfad',ramdisk_id='',reservation_id='r-42a5wi0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-757302542',owner_user_name='tempest-ServerStableDeviceRescueTest-757302542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7a69e6bcbf4ce3a0867b4f51564377',uuid=4a17123b-6ea8-450b-9ada-8c8278dcf739,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Converting VIF {"id": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "address": "fa:16:3e:bb:10:a5", "network": {"id": "ada601a5-86a5-4382-b1e3-b53be3e6364f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1448230522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "475e002776ae4e2e994cc801872bcfad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce93d51f-3e", "ovs_interfaceid": "ce93d51f-3ef0-48a2-b705-1a2d12fcccac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:10:a5,bridge_name='br-int',has_traffic_filtering=True,id=ce93d51f-3ef0-48a2-b705-1a2d12fcccac,network=Network(ada601a5-86a5-4382-b1e3-b53be3e6364f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce93d51f-3e') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG os_vif [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:10:a5,bridge_name='br-int',has_traffic_filtering=True,id=ce93d51f-3ef0-48a2-b705-1a2d12fcccac,network=Network(ada601a5-86a5-4382-b1e3-b53be3e6364f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce93d51f-3e') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce93d51f-3e, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:41 user nova-compute[73029]: INFO os_vif [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:10:a5,bridge_name='br-int',has_traffic_filtering=True,id=ce93d51f-3ef0-48a2-b705-1a2d12fcccac,network=Network(ada601a5-86a5-4382-b1e3-b53be3e6364f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce93d51f-3e')
Aug 10 00:42:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Deleting instance files /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739_del
Aug 10 00:42:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Deletion of /opt/stack/data/nova/instances/4a17123b-6ea8-450b-9ada-8c8278dcf739_del complete
Aug 10 00:42:42 user nova-compute[73029]: INFO nova.compute.manager [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 10 00:42:42 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:42:42 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:42:42 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:42:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:42:43 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Took 1.09 seconds to deallocate network for instance.
Aug 10 00:42:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-cc4decef-affe-4363-9199-5696d33dd760 req-52d2f2cc-3413-4a39-a26d-406ac071619d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc4decef-affe-4363-9199-5696d33dd760 req-52d2f2cc-3413-4a39-a26d-406ac071619d service nova] Acquiring lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc4decef-affe-4363-9199-5696d33dd760 req-52d2f2cc-3413-4a39-a26d-406ac071619d service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc4decef-affe-4363-9199-5696d33dd760 req-52d2f2cc-3413-4a39-a26d-406ac071619d service nova] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-cc4decef-affe-4363-9199-5696d33dd760 req-52d2f2cc-3413-4a39-a26d-406ac071619d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] No waiting events found dispatching network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:42:43 user nova-compute[73029]: WARNING nova.compute.manager [req-cc4decef-affe-4363-9199-5696d33dd760 req-52d2f2cc-3413-4a39-a26d-406ac071619d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received unexpected event network-vif-plugged-ce93d51f-3ef0-48a2-b705-1a2d12fcccac for instance with vm_state deleted and task_state None.
Aug 10 00:42:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-cc4decef-affe-4363-9199-5696d33dd760 req-52d2f2cc-3413-4a39-a26d-406ac071619d service nova] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Received event network-vif-deleted-ce93d51f-3ef0-48a2-b705-1a2d12fcccac {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:43 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Deleted allocations for instance 4a17123b-6ea8-450b-9ada-8c8278dcf739
Aug 10 00:42:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90829a0f-767e-4b86-9642-207f8d35d332 tempest-ServerStableDeviceRescueTest-757302542 tempest-ServerStableDeviceRescueTest-757302542-project-member] Lock "4a17123b-6ea8-450b-9ada-8c8278dcf739" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.615s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-4a704417-8dcc-41cd-89ac-2a02dd5ef973 req-c2f2c485-0d2e-42b4-91b1-e030800f222b service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-changed-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-4a704417-8dcc-41cd-89ac-2a02dd5ef973 req-c2f2c485-0d2e-42b4-91b1-e030800f222b service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Refreshing instance network info cache due to event network-changed-7e775285-84c8-4049-9914-d6b201090b0a. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4a704417-8dcc-41cd-89ac-2a02dd5ef973 req-c2f2c485-0d2e-42b4-91b1-e030800f222b service nova] Acquiring lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4a704417-8dcc-41cd-89ac-2a02dd5ef973 req-c2f2c485-0d2e-42b4-91b1-e030800f222b service nova] Acquired lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-4a704417-8dcc-41cd-89ac-2a02dd5ef973 req-c2f2c485-0d2e-42b4-91b1-e030800f222b service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Refreshing network info cache for port 7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquiring lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquiring lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:54 user nova-compute[73029]: INFO nova.compute.manager [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Terminating instance
Aug 10 00:42:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-5a0a4aab-51b4-4c00-add3-b340aa6ade06 req-62187988-1b74-4961-8b96-33be0133c10d service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received event network-vif-unplugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5a0a4aab-51b4-4c00-add3-b340aa6ade06 req-62187988-1b74-4961-8b96-33be0133c10d service nova] Acquiring lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5a0a4aab-51b4-4c00-add3-b340aa6ade06 req-62187988-1b74-4961-8b96-33be0133c10d service nova] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5a0a4aab-51b4-4c00-add3-b340aa6ade06 req-62187988-1b74-4961-8b96-33be0133c10d service nova] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-5a0a4aab-51b4-4c00-add3-b340aa6ade06 req-62187988-1b74-4961-8b96-33be0133c10d service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] No waiting events found dispatching network-vif-unplugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-5a0a4aab-51b4-4c00-add3-b340aa6ade06 req-62187988-1b74-4961-8b96-33be0133c10d service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received event network-vif-unplugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:42:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Instance destroyed successfully.
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.objects.instance [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lazy-loading 'resources' on Instance uuid 73d0b469-2ef5-4903-a9c3-8d658f0f058b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-313068804',display_name='tempest-VolumesNegativeTest-instance-313068804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-313068804',id=20,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a7e03aa93474bcebbce2920a374378f',ramdisk_id='',reservation_id='r-t08d49bn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-220084073',owner_user_name='tempest-VolumesNegativeTest-220084073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:41:16Z,user_data=None,user_id='f5ffe13879fa42f4b40de276e9de3ae8',uuid=73d0b469-2ef5-4903-a9c3-8d658f0f058b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Converting VIF {"id": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "address": "fa:16:3e:c3:15:31", "network": {"id": "65970639-5514-427c-8966-eb97f898b8a5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6fd81ae74ec04fb78f9e02c2f17a58cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a31d21d-14", "ovs_interfaceid": "0a31d21d-14d0-4144-931b-6e7ca73c81ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:15:31,bridge_name='br-int',has_traffic_filtering=True,id=0a31d21d-14d0-4144-931b-6e7ca73c81ae,network=Network(65970639-5514-427c-8966-eb97f898b8a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a31d21d-14') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG os_vif [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:15:31,bridge_name='br-int',has_traffic_filtering=True,id=0a31d21d-14d0-4144-931b-6e7ca73c81ae,network=Network(65970639-5514-427c-8966-eb97f898b8a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a31d21d-14') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a31d21d-14, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:42:55 user nova-compute[73029]: INFO os_vif [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:15:31,bridge_name='br-int',has_traffic_filtering=True,id=0a31d21d-14d0-4144-931b-6e7ca73c81ae,network=Network(65970639-5514-427c-8966-eb97f898b8a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a31d21d-14')
Aug 10 00:42:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Deleting instance files /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b_del
Aug 10 00:42:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Deletion of /opt/stack/data/nova/instances/73d0b469-2ef5-4903-a9c3-8d658f0f058b_del complete
Aug 10 00:42:55 user nova-compute[73029]: INFO nova.compute.manager [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 10 00:42:55 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.network.neutron [req-4a704417-8dcc-41cd-89ac-2a02dd5ef973 req-c2f2c485-0d2e-42b4-91b1-e030800f222b service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updated VIF entry in instance network info cache for port 7e775285-84c8-4049-9914-d6b201090b0a. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG nova.network.neutron [req-4a704417-8dcc-41cd-89ac-2a02dd5ef973 req-c2f2c485-0d2e-42b4-91b1-e030800f222b service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance_info_cache with network_info: [{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:42:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4a704417-8dcc-41cd-89ac-2a02dd5ef973 req-c2f2c485-0d2e-42b4-91b1-e030800f222b service nova] Releasing lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:42:56 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:42:56 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Took 0.65 seconds to deallocate network for instance.
Aug 10 00:42:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:56 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:42:56 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:42:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:56 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Deleted allocations for instance 73d0b469-2ef5-4903-a9c3-8d658f0f058b
Aug 10 00:42:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e2bd617d-ed11-4f7b-a92b-d7c01fca7f6c tempest-VolumesNegativeTest-220084073 tempest-VolumesNegativeTest-220084073-project-member] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:56 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628161.9413216, 4a17123b-6ea8-450b-9ada-8c8278dcf739 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:42:56 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] VM Stopped (Lifecycle Event)
Aug 10 00:42:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-51cf4b03-cde7-4a26-9264-ea7b4b93db39 None None] [instance: 4a17123b-6ea8-450b-9ada-8c8278dcf739] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:42:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-24a680e8-e525-432e-99aa-0430d574ee6d req-3c76143c-beff-472c-b28a-abdb7c3f546a service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received event network-vif-plugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-24a680e8-e525-432e-99aa-0430d574ee6d req-3c76143c-beff-472c-b28a-abdb7c3f546a service nova] Acquiring lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:42:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-24a680e8-e525-432e-99aa-0430d574ee6d req-3c76143c-beff-472c-b28a-abdb7c3f546a service nova] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:42:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-24a680e8-e525-432e-99aa-0430d574ee6d req-3c76143c-beff-472c-b28a-abdb7c3f546a service nova] Lock "73d0b469-2ef5-4903-a9c3-8d658f0f058b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:42:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-24a680e8-e525-432e-99aa-0430d574ee6d req-3c76143c-beff-472c-b28a-abdb7c3f546a service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] No waiting events found dispatching network-vif-plugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:42:57 user nova-compute[73029]: WARNING nova.compute.manager [req-24a680e8-e525-432e-99aa-0430d574ee6d req-3c76143c-beff-472c-b28a-abdb7c3f546a service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received unexpected event network-vif-plugged-0a31d21d-14d0-4144-931b-6e7ca73c81ae for instance with vm_state deleted and task_state None.
Aug 10 00:42:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-24a680e8-e525-432e-99aa-0430d574ee6d req-3c76143c-beff-472c-b28a-abdb7c3f546a service nova] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Received event network-vif-deleted-0a31d21d-14d0-4144-931b-6e7ca73c81ae {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:42:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:01 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'flavor' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:43:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:02 user nova-compute[73029]: INFO nova.compute.manager [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Attaching volume 1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 to /dev/vdb
Aug 10 00:43:02 user nova-compute[73029]: DEBUG os_brick.utils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e5ae2-a6b0-4a57-b7ed-af9ddf522597]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfca4476-d424-4577-ad8e-e94ad772ea18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52271c6-4999-4505-bc98-809b1646470f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[874431b6-807b-4645-9255-3036804a623d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:43:02 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:43:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba7401f-f920-4e56-be21-7d34ecf01d08]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG os_brick.utils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:43:02 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updating existing volume attachment record: 89bb1741-8eca-4f80-a113-70e50f8c8506 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:43:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628175.2252877, 73d0b469-2ef5-4903-a9c3-8d658f0f058b => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:43:10 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] VM Stopped (Lifecycle Event)
Aug 10 00:43:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-af52ad03-5b30-4b31-82c5-9eb1556c3917 None None] [instance: 73d0b469-2ef5-4903-a9c3-8d658f0f058b] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFfUitaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:43:10 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:43:10 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:43:10 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a75f0-3e4f-43e1-b11c-2f6ec5b1e080]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:43:10 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4071998-4034-475c-ad32-62c848465735]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7] added
Aug 10 00:43:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b87f235-5d04-4050-a943-c6553c832554]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff81b066-87d3-4232-89a4-1dade7352d0e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFfUitaN {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFfUitaN" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b04d28f-5130-4a71-a9ea-39d29e225ddf]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OFfUitaN'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37d538f-6225-44fb-832f-8338e155c747]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5482c1a0-dbe9-48e6-9746-7e89502a13ef]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 00:43:10 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 00:43:10 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:43:10 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 00:43:10 user nova-compute[73029]: 
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c18a5bb-0a6e-4512-a1da-acf345a2bb38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260]
Aug 10 00:43:10 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260] successful.
Aug 10 00:43:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef3d4f2-d8be-42f2-ab99-d1b9705c49b2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa35407-c571-405d-98d2-145fcd1d1eff]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:43:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:43:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0c403f-efd1-4ebd-a52e-240d1a6222f0]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:43:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFfUitaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:43:11 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:43:11 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26464383966303363', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:43:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464383966303363', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:43:11 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'flavor' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:43:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:43:11 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:43:11 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:43:11 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:43:11 user nova-compute[73029]:   <serial>1af2a0ff-56b7-44a7-b563-7cd4155d8eb7</serial>
Aug 10 00:43:11 user nova-compute[73029]: </disk>
Aug 10 00:43:11 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:43:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:43:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No VIF found with MAC fa:16:3e:b5:50:03, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0c1b94a0-2a3c-47b7-a10f-9c15004a4181 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.342s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:43:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:43:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:43:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:43:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:43:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Updating instance_info_cache with network_info: [{"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:43:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-5e356ed0-276c-4a27-9294-3176cc022c18" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:43:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:43:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-ea195d77-afa2-429e-b8ea-565f28d752d6 req-e926f72e-5431-4c55-aa08-932a336fea0d service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-ea195d77-afa2-429e-b8ea-565f28d752d6 req-e926f72e-5431-4c55-aa08-932a336fea0d service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing instance network info cache due to event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ea195d77-afa2-429e-b8ea-565f28d752d6 req-e926f72e-5431-4c55-aa08-932a336fea0d service nova] Acquiring lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ea195d77-afa2-429e-b8ea-565f28d752d6 req-e926f72e-5431-4c55-aa08-932a336fea0d service nova] Acquired lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-ea195d77-afa2-429e-b8ea-565f28d752d6 req-e926f72e-5431-4c55-aa08-932a336fea0d service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-ea195d77-afa2-429e-b8ea-565f28d752d6 req-e926f72e-5431-4c55-aa08-932a336fea0d service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updated VIF entry in instance network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-ea195d77-afa2-429e-b8ea-565f28d752d6 req-e926f72e-5431-4c55-aa08-932a336fea0d service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updating instance_info_cache with network_info: [{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ea195d77-afa2-429e-b8ea-565f28d752d6 req-e926f72e-5431-4c55-aa08-932a336fea0d service nova] Releasing lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-fe6c1c1a-41ec-402f-9148-2a4fb8d53d35 req-719b4f42-32fa-45d5-ac6a-415ec8197977 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-fe6c1c1a-41ec-402f-9148-2a4fb8d53d35 req-719b4f42-32fa-45d5-ac6a-415ec8197977 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing instance network info cache due to event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fe6c1c1a-41ec-402f-9148-2a4fb8d53d35 req-719b4f42-32fa-45d5-ac6a-415ec8197977 service nova] Acquiring lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fe6c1c1a-41ec-402f-9148-2a4fb8d53d35 req-719b4f42-32fa-45d5-ac6a-415ec8197977 service nova] Acquired lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG nova.network.neutron [req-fe6c1c1a-41ec-402f-9148-2a4fb8d53d35 req-719b4f42-32fa-45d5-ac6a-415ec8197977 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:25 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:43:25 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7700MB free_disk=25.319812774658203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 5e356ed0-276c-4a27-9294-3176cc022c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 889d1049-c384-4ad3-837c-4c739f345e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-fe6c1c1a-41ec-402f-9148-2a4fb8d53d35 req-719b4f42-32fa-45d5-ac6a-415ec8197977 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updated VIF entry in instance network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-fe6c1c1a-41ec-402f-9148-2a4fb8d53d35 req-719b4f42-32fa-45d5-ac6a-415ec8197977 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updating instance_info_cache with network_info: [{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fe6c1c1a-41ec-402f-9148-2a4fb8d53d35 req-719b4f42-32fa-45d5-ac6a-415ec8197977 service nova] Releasing lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:43:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:27 user nova-compute[73029]: INFO nova.compute.manager [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Terminating instance
Aug 10 00:43:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d771396-8b30-4938-b519-2aedf17e77b7 req-9e429c5f-92c1-462a-8b6d-b98994272077 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received event network-vif-unplugged-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d771396-8b30-4938-b519-2aedf17e77b7 req-9e429c5f-92c1-462a-8b6d-b98994272077 service nova] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d771396-8b30-4938-b519-2aedf17e77b7 req-9e429c5f-92c1-462a-8b6d-b98994272077 service nova] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1d771396-8b30-4938-b519-2aedf17e77b7 req-9e429c5f-92c1-462a-8b6d-b98994272077 service nova] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d771396-8b30-4938-b519-2aedf17e77b7 req-9e429c5f-92c1-462a-8b6d-b98994272077 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] No waiting events found dispatching network-vif-unplugged-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-1d771396-8b30-4938-b519-2aedf17e77b7 req-9e429c5f-92c1-462a-8b6d-b98994272077 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received event network-vif-unplugged-9dfbbab5-a67c-4672-b965-328591564d2c for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:43:28 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Instance destroyed successfully.
Aug 10 00:43:28 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lazy-loading 'resources' on Instance uuid 5e356ed0-276c-4a27-9294-3176cc022c18 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1166444685',display_name='tempest-TestVolumeSwap-server-1166444685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1166444685',id=15,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQFWS1Hzo84fgtzfKF/HW0a7WWgdBymKCnZ0w/W1Tm6r9d+BTEXjrMoh6ZfEo+N2IdVluKF+xrNPqoL7F1iIxseAj98sZtwu+OJJkT6bZSFpZdhPLcU/STPB12SEPKeeQ==',key_name='tempest-keypair-630292605',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:40:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa3ad2bae432474e92d1d111907f5fc4',ramdisk_id='',reservation_id='r-xt1cq3hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1189001466',owner_user_name='tempest-TestVolumeSwap-1189001466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad2270c0a6174155935ad1ed13f26248',uuid=5e356ed0-276c-4a27-9294-3176cc022c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Converting VIF {"id": "9dfbbab5-a67c-4672-b965-328591564d2c", "address": "fa:16:3e:5a:28:f2", "network": {"id": "518d382e-685c-48b4-a0a1-b645fcba9fd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1473387366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa3ad2bae432474e92d1d111907f5fc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfbbab5-a6", "ovs_interfaceid": "9dfbbab5-a67c-4672-b965-328591564d2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=9dfbbab5-a67c-4672-b965-328591564d2c,network=Network(518d382e-685c-48b4-a0a1-b645fcba9fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfbbab5-a6') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG os_vif [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=9dfbbab5-a67c-4672-b965-328591564d2c,network=Network(518d382e-685c-48b4-a0a1-b645fcba9fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfbbab5-a6') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dfbbab5-a6, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:28 user nova-compute[73029]: INFO os_vif [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=9dfbbab5-a67c-4672-b965-328591564d2c,network=Network(518d382e-685c-48b4-a0a1-b645fcba9fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfbbab5-a6')
Aug 10 00:43:28 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Deleting instance files /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18_del
Aug 10 00:43:28 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Deletion of /opt/stack/data/nova/instances/5e356ed0-276c-4a27-9294-3176cc022c18_del complete
Aug 10 00:43:28 user nova-compute[73029]: INFO nova.compute.manager [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 10 00:43:28 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:43:28 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:43:29 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:43:29 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Took 1.10 seconds to deallocate network for instance.
Aug 10 00:43:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-56830579-e935-4e36-9d44-51e508dee405 req-0355bfd8-36b6-460b-9a88-81263a0b69ac service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received event network-vif-deleted-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:43:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:29 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:43:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:43:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:29 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Deleted allocations for instance 5e356ed0-276c-4a27-9294-3176cc022c18
Aug 10 00:43:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c7d8925b-1c7f-4b74-b8d9-e191e484ac31 tempest-TestVolumeSwap-1189001466 tempest-TestVolumeSwap-1189001466-project-member] Lock "5e356ed0-276c-4a27-9294-3176cc022c18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.575s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-083eaecc-b0d3-44bc-bdb9-f5fba0444ac7 req-93de54cf-8860-4fcd-a2c5-c3244b8cc785 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received event network-vif-plugged-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:43:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-083eaecc-b0d3-44bc-bdb9-f5fba0444ac7 req-93de54cf-8860-4fcd-a2c5-c3244b8cc785 service nova] Acquiring lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-083eaecc-b0d3-44bc-bdb9-f5fba0444ac7 req-93de54cf-8860-4fcd-a2c5-c3244b8cc785 service nova] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-083eaecc-b0d3-44bc-bdb9-f5fba0444ac7 req-93de54cf-8860-4fcd-a2c5-c3244b8cc785 service nova] Lock "5e356ed0-276c-4a27-9294-3176cc022c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-083eaecc-b0d3-44bc-bdb9-f5fba0444ac7 req-93de54cf-8860-4fcd-a2c5-c3244b8cc785 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] No waiting events found dispatching network-vif-plugged-9dfbbab5-a67c-4672-b965-328591564d2c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:43:30 user nova-compute[73029]: WARNING nova.compute.manager [req-083eaecc-b0d3-44bc-bdb9-f5fba0444ac7 req-93de54cf-8860-4fcd-a2c5-c3244b8cc785 service nova] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Received unexpected event network-vif-plugged-9dfbbab5-a67c-4672-b965-328591564d2c for instance with vm_state deleted and task_state None.
Aug 10 00:43:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:30 user nova-compute[73029]: INFO nova.compute.manager [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Rebooting instance
Aug 10 00:43:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:43:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquired lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:43:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG nova.network.neutron [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updating instance_info_cache with network_info: [{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Releasing lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-28b87656-cdc8-4860-b88c-9e932cfbc511 req-d8cddb6c-338f-4bd3-844e-68a35c0297da service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-unplugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-28b87656-cdc8-4860-b88c-9e932cfbc511 req-d8cddb6c-338f-4bd3-844e-68a35c0297da service nova] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-28b87656-cdc8-4860-b88c-9e932cfbc511 req-d8cddb6c-338f-4bd3-844e-68a35c0297da service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-28b87656-cdc8-4860-b88c-9e932cfbc511 req-d8cddb6c-338f-4bd3-844e-68a35c0297da service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-28b87656-cdc8-4860-b88c-9e932cfbc511 req-d8cddb6c-338f-4bd3-844e-68a35c0297da service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] No waiting events found dispatching network-vif-unplugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:43:31 user nova-compute[73029]: WARNING nova.compute.manager [req-28b87656-cdc8-4860-b88c-9e932cfbc511 req-d8cddb6c-338f-4bd3-844e-68a35c0297da service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received unexpected event network-vif-unplugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b for instance with vm_state active and task_state reboot_started_hard.
Aug 10 00:43:32 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Instance destroyed successfully.
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'resources' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724206694',display_name='tempest-TestMinimumBasicScenario-server-724206694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724206694',id=21,image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyvuwaNsaWL2ieB5B79GJsBSEJ1Puvg7jYv05H2n+tMu8V79v3UFwmPyW2Gxwu3XdgLMPSnIB+Cj/GsdfVHMUSkaSjDi1U1zPbizPUbOfg7Bwx1n4YcjkMP0EKGUBAW1A==',key_name='tempest-TestMinimumBasicScenario-943275705',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:41:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bdf72afe44346ebae59db7a6d57a787',ramdisk_id='',reservation_id='r-cu10n5db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-379185014',owner_user_name='tempest-TestMinimumBasicScenario-379185014-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:43:31Z,user_data=None,user_id='e4fd570e277240d1b7c1b910a9289aad',uuid=872fce9b-adf0-4c6f-820e-0d76b59ea36d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converting VIF {"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_vif [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe6b05f6-41, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:43:32 user nova-compute[73029]: INFO os_vif [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41')
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFfUitaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:43:32 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdec59f-08c8-4c18-9c11-1e8cf273d608]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ab1b41-4296-485e-87ed-5b0a2311bf17]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141bdb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d3afa-9452-452b-89b3-658425504dbe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6f60dd-4402-47dd-837b-d2c823935f59]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf594c6-be7f-46d7-8b14-1ce93d4cf61a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40664e3-448c-460f-8bd0-dd5285a5abab]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e7c52a-497a-47be-b88b-23bc06cbad24]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adb4d13-009c-4559-8629-51a470a4f1df]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260]
Aug 10 00:43:32 user nova-compute[73029]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260] successful.
Aug 10 00:43:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3b4796-22e3-4968-8bf0-c08923166cd2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] <== disconnect_volume: return (305ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Start _get_guest_xml network_info=[{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a16bbdbd-1f9c-4f09-a0bd-e377815e3823,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': 'a16bbdbd-1f9c-4f09-a0bd-e377815e3823'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '89bb1741-8eca-4f80-a113-70e50f8c8506', 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFfUitaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '872fce9b-adf0-4c6f-820e-0d76b59ea36d', 'attached_at': '', 'detached_at': '', 'volume_id': '1af2a0ff-56b7-44a7-b563-7cd4155d8eb7', 'serial': '1af2a0ff-56b7-44a7-b563-7cd4155d8eb7'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:43:32 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:43:32 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a16bbdbd-1f9c-4f09-a0bd-e377815e3823,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'vcpu_model' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFfUitaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:43:32 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:43:32 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:43:32 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5270c84a-b569-45b9-915a-c46f9c1ca662]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:43:32 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4a10d4-d908-47ce-b4ed-e238c7566426]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7] added
Aug 10 00:43:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2f8f14-788e-44c5-b89f-8f89c893e152]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d6e6c-e62d-4c48-ac69-72b0a6719c9f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFfUitaN {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFfUitaN" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[88683166-f48d-4074-acc4-ceef371d5943]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OFfUitaN'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f921dae-d6e3-482c-b55d-ef9a5b5dcc7e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1b98ac-8fc0-4ded-b009-d020a489fcfe]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[02716364-9d2f-468a-9be1-95e193a69f7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260]
Aug 10 00:43:32 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260] successful.
Aug 10 00:43:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9588b271-844f-41e7-b534-404a24b1ca36]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c94f48-6530-4118-ae12-603ccbdb7cbe]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8179e6-8829-48ca-b6b2-94e9c3584a07 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:43:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28b94cf-c8fe-4a8d-895d-a0fec10d930b]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:43:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:43:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-b7c70906-c9e9-45c3-b56b-015bf7364060 req-53e7afa9-060a-4f32-ad7e-910b7f3d0f72 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:43:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7c70906-c9e9-45c3-b56b-015bf7364060 req-53e7afa9-060a-4f32-ad7e-910b7f3d0f72 service nova] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7c70906-c9e9-45c3-b56b-015bf7364060 req-53e7afa9-060a-4f32-ad7e-910b7f3d0f72 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b7c70906-c9e9-45c3-b56b-015bf7364060 req-53e7afa9-060a-4f32-ad7e-910b7f3d0f72 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-b7c70906-c9e9-45c3-b56b-015bf7364060 req-53e7afa9-060a-4f32-ad7e-910b7f3d0f72 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] No waiting events found dispatching network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:43:33 user nova-compute[73029]: WARNING nova.compute.manager [req-b7c70906-c9e9-45c3-b56b-015bf7364060 req-53e7afa9-060a-4f32-ad7e-910b7f3d0f72 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received unexpected event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b for instance with vm_state active and task_state reboot_started_hard.
Aug 10 00:43:33 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFfUitaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26464383966303363', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464383966303363', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724206694',display_name='tempest-TestMinimumBasicScenario-server-724206694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724206694',id=21,image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyvuwaNsaWL2ieB5B79GJsBSEJ1Puvg7jYv05H2n+tMu8V79v3UFwmPyW2Gxwu3XdgLMPSnIB+Cj/GsdfVHMUSkaSjDi1U1zPbizPUbOfg7Bwx1n4YcjkMP0EKGUBAW1A==',key_name='tempest-TestMinimumBasicScenario-943275705',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:41:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bdf72afe44346ebae59db7a6d57a787',ramdisk_id='',reservation_id='r-cu10n5db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-379185014',owner_user_name='tempest-TestMinimumBasicScenario-379185014-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:43:31Z,user_data=None,user_id='e4fd570e277240d1b7c1b910a9289aad',uuid=872fce9b-adf0-4c6f-820e-0d76b59ea36d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converting VIF {"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'pci_devices' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:43:34 user nova-compute[73029]:   <uuid>872fce9b-adf0-4c6f-820e-0d76b59ea36d</uuid>
Aug 10 00:43:34 user nova-compute[73029]:   <name>instance-00000015</name>
Aug 10 00:43:34 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:43:34 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:43:34 user nova-compute[73029]:   <metadata>
Aug 10 00:43:34 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:43:34 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:43:34 user nova-compute[73029]:       <nova:name>tempest-TestMinimumBasicScenario-server-724206694</nova:name>
Aug 10 00:43:34 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:43:32</nova:creationTime>
Aug 10 00:43:34 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:43:34 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:43:34 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:43:34 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:43:34 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:43:34 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:43:34 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:43:34 user nova-compute[73029]:       <nova:owner>
Aug 10 00:43:34 user nova-compute[73029]:         <nova:user uuid="e4fd570e277240d1b7c1b910a9289aad">tempest-TestMinimumBasicScenario-379185014-project-member</nova:user>
Aug 10 00:43:34 user nova-compute[73029]:         <nova:project uuid="2bdf72afe44346ebae59db7a6d57a787">tempest-TestMinimumBasicScenario-379185014</nova:project>
Aug 10 00:43:34 user nova-compute[73029]:       </nova:owner>
Aug 10 00:43:34 user nova-compute[73029]:       <nova:root type="image" uuid="a16bbdbd-1f9c-4f09-a0bd-e377815e3823"/>
Aug 10 00:43:34 user nova-compute[73029]:       <nova:ports>
Aug 10 00:43:34 user nova-compute[73029]:         <nova:port uuid="be6b05f6-41c0-47d0-b2a1-e9a5619ce08b">
Aug 10 00:43:34 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 10 00:43:34 user nova-compute[73029]:         </nova:port>
Aug 10 00:43:34 user nova-compute[73029]:       </nova:ports>
Aug 10 00:43:34 user nova-compute[73029]:     </nova:instance>
Aug 10 00:43:34 user nova-compute[73029]:   </metadata>
Aug 10 00:43:34 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:43:34 user nova-compute[73029]:     <system>
Aug 10 00:43:34 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:43:34 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:43:34 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:43:34 user nova-compute[73029]:       <entry name="serial">872fce9b-adf0-4c6f-820e-0d76b59ea36d</entry>
Aug 10 00:43:34 user nova-compute[73029]:       <entry name="uuid">872fce9b-adf0-4c6f-820e-0d76b59ea36d</entry>
Aug 10 00:43:34 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:43:34 user nova-compute[73029]:     </system>
Aug 10 00:43:34 user nova-compute[73029]:   </sysinfo>
Aug 10 00:43:34 user nova-compute[73029]:   <os>
Aug 10 00:43:34 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:43:34 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:43:34 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:43:34 user nova-compute[73029]:   </os>
Aug 10 00:43:34 user nova-compute[73029]:   <features>
Aug 10 00:43:34 user nova-compute[73029]:     <acpi/>
Aug 10 00:43:34 user nova-compute[73029]:     <apic/>
Aug 10 00:43:34 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:43:34 user nova-compute[73029]:   </features>
Aug 10 00:43:34 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:43:34 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:43:34 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:43:34 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:43:34 user nova-compute[73029]:   </clock>
Aug 10 00:43:34 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:43:34 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:43:34 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:43:34 user nova-compute[73029]:   </cpu>
Aug 10 00:43:34 user nova-compute[73029]:   <devices>
Aug 10 00:43:34 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:43:34 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:43:34 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk"/>
Aug 10 00:43:34 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:43:34 user nova-compute[73029]:     </disk>
Aug 10 00:43:34 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:43:34 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:43:34 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 00:43:34 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:43:34 user nova-compute[73029]:       <serial>1af2a0ff-56b7-44a7-b563-7cd4155d8eb7</serial>
Aug 10 00:43:34 user nova-compute[73029]:     </disk>
Aug 10 00:43:34 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:43:34 user nova-compute[73029]:       <mac address="fa:16:3e:b5:50:03"/>
Aug 10 00:43:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:43:34 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:43:34 user nova-compute[73029]:       <target dev="tapbe6b05f6-41"/>
Aug 10 00:43:34 user nova-compute[73029]:     </interface>
Aug 10 00:43:34 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:43:34 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/console.log" append="off"/>
Aug 10 00:43:34 user nova-compute[73029]:     </serial>
Aug 10 00:43:34 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:43:34 user nova-compute[73029]:     <video>
Aug 10 00:43:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:43:34 user nova-compute[73029]:     </video>
Aug 10 00:43:34 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:43:34 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:43:34 user nova-compute[73029]:     </rng>
Aug 10 00:43:34 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:43:34 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:43:34 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:43:34 user nova-compute[73029]:     </memballoon>
Aug 10 00:43:34 user nova-compute[73029]:   </devices>
Aug 10 00:43:34 user nova-compute[73029]: </domain>
Aug 10 00:43:34 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'trusted_certs' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Checking if we can resize image /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Cannot resize image /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:43:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'migration_context' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724206694',display_name='tempest-TestMinimumBasicScenario-server-724206694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724206694',id=21,image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyvuwaNsaWL2ieB5B79GJsBSEJ1Puvg7jYv05H2n+tMu8V79v3UFwmPyW2Gxwu3XdgLMPSnIB+Cj/GsdfVHMUSkaSjDi1U1zPbizPUbOfg7Bwx1n4YcjkMP0EKGUBAW1A==',key_name='tempest-TestMinimumBasicScenario-943275705',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:41:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2bdf72afe44346ebae59db7a6d57a787',ramdisk_id='',reservation_id='r-cu10n5db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-379185014',owner_user_name='tempest-TestMinimumBasicScenario-379185014-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:43:31Z,user_data=None,user_id='e4fd570e277240d1b7c1b910a9289aad',uuid=872fce9b-adf0-4c6f-820e-0d76b59ea36d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converting VIF {"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG os_vif [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe6b05f6-41, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe6b05f6-41, col_values=(('external_ids', {'iface-id': 'be6b05f6-41c0-47d0-b2a1-e9a5619ce08b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:50:03', 'vm-uuid': '872fce9b-adf0-4c6f-820e-0d76b59ea36d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:43:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:35 user nova-compute[73029]: INFO os_vif [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41')
Aug 10 00:43:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-48118398-da52-455c-9b67-f9a9454e5a7e req-3a9bc14e-7a82-41f5-9acc-93effaca9e54 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:43:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-48118398-da52-455c-9b67-f9a9454e5a7e req-3a9bc14e-7a82-41f5-9acc-93effaca9e54 service nova] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-48118398-da52-455c-9b67-f9a9454e5a7e req-3a9bc14e-7a82-41f5-9acc-93effaca9e54 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-48118398-da52-455c-9b67-f9a9454e5a7e req-3a9bc14e-7a82-41f5-9acc-93effaca9e54 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-48118398-da52-455c-9b67-f9a9454e5a7e req-3a9bc14e-7a82-41f5-9acc-93effaca9e54 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] No waiting events found dispatching network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:43:38 user nova-compute[73029]: WARNING nova.compute.manager [req-48118398-da52-455c-9b67-f9a9454e5a7e req-3a9bc14e-7a82-41f5-9acc-93effaca9e54 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received unexpected event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b for instance with vm_state active and task_state reboot_started_hard.
Aug 10 00:43:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-0fe64112-cf9e-4022-ace6-ece3748c98b5 req-658c9725-2866-4065-bcdc-e96e77983500 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0fe64112-cf9e-4022-ace6-ece3748c98b5 req-658c9725-2866-4065-bcdc-e96e77983500 service nova] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0fe64112-cf9e-4022-ace6-ece3748c98b5 req-658c9725-2866-4065-bcdc-e96e77983500 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0fe64112-cf9e-4022-ace6-ece3748c98b5 req-658c9725-2866-4065-bcdc-e96e77983500 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-0fe64112-cf9e-4022-ace6-ece3748c98b5 req-658c9725-2866-4065-bcdc-e96e77983500 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] No waiting events found dispatching network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:43:40 user nova-compute[73029]: WARNING nova.compute.manager [req-0fe64112-cf9e-4022-ace6-ece3748c98b5 req-658c9725-2866-4065-bcdc-e96e77983500 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received unexpected event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b for instance with vm_state active and task_state reboot_started_hard.
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 872fce9b-adf0-4c6f-820e-0d76b59ea36d due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628220.6792214, 872fce9b-adf0-4c6f-820e-0d76b59ea36d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:43:40 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] VM Resumed (Lifecycle Event)
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:43:40 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Instance rebooted successfully.
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:43:40 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628220.6814194, 872fce9b-adf0-4c6f-820e-0d76b59ea36d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:43:40 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] VM Started (Lifecycle Event)
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:43:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9285eb09-d24f-481d-b2d7-00df17a20215 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.456s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:43:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:43 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628208.2887106, 5e356ed0-276c-4a27-9294-3176cc022c18 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:43:43 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] VM Stopped (Lifecycle Event)
Aug 10 00:43:43 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7010db0f-fee6-41aa-820a-6355a5b400d6 None None] [instance: 5e356ed0-276c-4a27-9294-3176cc022c18] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:43:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:43:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-530ee1d4-34ab-42e6-9f45-84065d05a4a8 req-f39e46ab-9364-4102-96e8-fa723ca55342 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received event network-changed-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:44:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-530ee1d4-34ab-42e6-9f45-84065d05a4a8 req-f39e46ab-9364-4102-96e8-fa723ca55342 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Refreshing instance network info cache due to event network-changed-ebba57ea-ef60-4d81-84a0-91ed11028df9. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:44:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-530ee1d4-34ab-42e6-9f45-84065d05a4a8 req-f39e46ab-9364-4102-96e8-fa723ca55342 service nova] Acquiring lock "refresh_cache-889d1049-c384-4ad3-837c-4c739f345e1c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:44:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-530ee1d4-34ab-42e6-9f45-84065d05a4a8 req-f39e46ab-9364-4102-96e8-fa723ca55342 service nova] Acquired lock "refresh_cache-889d1049-c384-4ad3-837c-4c739f345e1c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:44:06 user nova-compute[73029]: DEBUG nova.network.neutron [req-530ee1d4-34ab-42e6-9f45-84065d05a4a8 req-f39e46ab-9364-4102-96e8-fa723ca55342 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Refreshing network info cache for port ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:44:07 user nova-compute[73029]: DEBUG nova.network.neutron [req-530ee1d4-34ab-42e6-9f45-84065d05a4a8 req-f39e46ab-9364-4102-96e8-fa723ca55342 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Updated VIF entry in instance network info cache for port ebba57ea-ef60-4d81-84a0-91ed11028df9. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:44:07 user nova-compute[73029]: DEBUG nova.network.neutron [req-530ee1d4-34ab-42e6-9f45-84065d05a4a8 req-f39e46ab-9364-4102-96e8-fa723ca55342 service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Updating instance_info_cache with network_info: [{"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:44:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-530ee1d4-34ab-42e6-9f45-84065d05a4a8 req-f39e46ab-9364-4102-96e8-fa723ca55342 service nova] Releasing lock "refresh_cache-889d1049-c384-4ad3-837c-4c739f345e1c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:44:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:15 user nova-compute[73029]: DEBUG nova.objects.instance [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'flavor' on Instance uuid 889d1049-c384-4ad3-837c-4c739f345e1c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:44:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:15 user nova-compute[73029]: INFO nova.compute.manager [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Attaching volume 99229cf9-bda7-451e-afb2-b36023533121 to /dev/vdb
Aug 10 00:44:16 user nova-compute[73029]: DEBUG os_brick.utils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[088397b9-e8d5-4a77-bbe4-5b74a38db181]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a41a26-dc65-4750-ad6b-a4dd46844938]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e207d7e7-1402-4102-9d3d-aaae16614c61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6158de-a01e-444f-9e2e-7ebdf3c5be6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:44:16 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:44:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ef9a8-f2ba-439d-9bd1-cfd1fa88c671]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG os_brick.utils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:44:16 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Updating existing volume attachment record: 844e9700-222b-402d-9950-87676c7f64ac {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:44:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:44:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:44:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:44:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:44:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:44:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updating instance_info_cache with network_info: [{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:44:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:44:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:44:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:44:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:44:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:44:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:44:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:44:22 user nova-compute[73029]: INFO nova.compute.claims [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Claim successful on node user
Aug 10 00:44:22 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:44:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG nova.network.neutron [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:44:23 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:44:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG nova.policy [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '066b8c956dd146209ae7ecabfbf083ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60aabdbd31b647d68db993c0a60a43ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:44:23 user nova-compute[73029]: INFO nova.virt.block_device [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Booting with volume bb934ac5-976b-4e1f-8572-2a365db9d227 at /dev/vda
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG os_brick.utils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[753b4113-f279-40ed-88c6-8335a23983ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e21e7-5bc1-47fc-ac55-f13bc2b8bb46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbd73b6-1e61-42f3-b5f2-7bc3a014a9a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5030f3d-48a8-4efa-8f60-bc201932b2ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:44:23 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455f156-ea75-47a0-a793-0883c40bb352]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG os_brick.utils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating existing volume attachment record: 222d0f8f-03e0-4bd4-b86f-b5aeab662bb2 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:23 user nova-compute[73029]: DEBUG nova.network.neutron [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Successfully created port: 24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Successfully updated port: 24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquired lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-ad6a0fb7-a718-4299-9150-76ded56aa599 req-ef3366cf-2656-4ec6-a336-53b9c0f2d0bf service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-changed-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-ad6a0fb7-a718-4299-9150-76ded56aa599 req-ef3366cf-2656-4ec6-a336-53b9c0f2d0bf service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Refreshing instance network info cache due to event network-changed-24e98d91-db37-4730-97d2-f9fb3cf8c9a0. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ad6a0fb7-a718-4299-9150-76ded56aa599 req-ef3366cf-2656-4ec6-a336-53b9c0f2d0bf service nova] Acquiring lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG nova.network.neutron [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating instance_info_cache with network_info: [{"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Releasing lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Instance network_info: |[{"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ad6a0fb7-a718-4299-9150-76ded56aa599 req-ef3366cf-2656-4ec6-a336-53b9c0f2d0bf service nova] Acquired lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-ad6a0fb7-a718-4299-9150-76ded56aa599 req-ef3366cf-2656-4ec6-a336-53b9c0f2d0bf service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Refreshing network info cache for port 24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:26 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:44:26 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7881MB free_disk=25.33316421508789GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-ad6a0fb7-a718-4299-9150-76ded56aa599 req-ef3366cf-2656-4ec6-a336-53b9c0f2d0bf service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updated VIF entry in instance network info cache for port 24e98d91-db37-4730-97d2-f9fb3cf8c9a0. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-ad6a0fb7-a718-4299-9150-76ded56aa599 req-ef3366cf-2656-4ec6-a336-53b9c0f2d0bf service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating instance_info_cache with network_info: [{"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ad6a0fb7-a718-4299-9150-76ded56aa599 req-ef3366cf-2656-4ec6-a336-53b9c0f2d0bf service nova] Releasing lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 889d1049-c384-4ad3-837c-4c739f345e1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a759a046-b39b-4c7d-88ce-bf6922af5a81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:44:32 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Creating image(s)
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Ensure instance console log exists: /opt/stack/data/nova/instances/a759a046-b39b-4c7d-88ce-bf6922af5a81/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Start _get_guest_xml network_info=[{"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '222d0f8f-03e0-4bd4-b86f-b5aeab662bb2', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyHhNILq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a759a046-b39b-4c7d-88ce-bf6922af5a81', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb934ac5-976b-4e1f-8572-2a365db9d227', 'serial': 'bb934ac5-976b-4e1f-8572-2a365db9d227'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:44:32 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:44:32 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyHhNILq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:44:32 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:44:32 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:44:32 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65e8747-6487-40d6-82f5-fe780c557eb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:44:32 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16245e7-74fc-4228-abfc-da4ec202ad7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227] added
Aug 10 00:44:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[893394f5-4f89-4e6c-8e06-9ddda2930f34]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8ac319-674a-4aef-adfa-c8922a01c31d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyHhNILq {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyHhNILq" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e3724b-5bfd-4911-86cf-27fba1211909]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tyHhNILq'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de8b22c-4397-427d-86ba-6c0b9d98731a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a171b89-05b4-4128-9863-fffab7a32636]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:44:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:44:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[65412f92-b0c5-4389-b3da-75cba4cb8b33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260]
Aug 10 00:44:32 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260] successful.
Aug 10 00:44:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[475227d9-9971-4672-ba09-31b8276e3d7f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2680cc13-7436-4758-bf4a-4c37d7c03662]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:44:32 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:44:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:44:32 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:44:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3868389a-1af7-41ab-aa82-1ae07836f53e]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyHhNILq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23433346337646566', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433346337646566', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-774975152',display_name='tempest-ServerActionsTestOtherA-server-774975152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-774975152',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-6uqo1cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=a759a046-b39b-4c7d-88ce-bf6922af5a81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.objects.instance [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'pci_devices' on Instance uuid a759a046-b39b-4c7d-88ce-bf6922af5a81 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:44:33 user nova-compute[73029]:   <uuid>a759a046-b39b-4c7d-88ce-bf6922af5a81</uuid>
Aug 10 00:44:33 user nova-compute[73029]:   <name>instance-00000017</name>
Aug 10 00:44:33 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:44:33 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:44:33 user nova-compute[73029]:   <metadata>
Aug 10 00:44:33 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:44:33 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:44:33 user nova-compute[73029]:       <nova:name>tempest-ServerActionsTestOtherA-server-774975152</nova:name>
Aug 10 00:44:33 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:44:32</nova:creationTime>
Aug 10 00:44:33 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:44:33 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:44:33 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:44:33 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:44:33 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:44:33 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:44:33 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:44:33 user nova-compute[73029]:       <nova:owner>
Aug 10 00:44:33 user nova-compute[73029]:         <nova:user uuid="066b8c956dd146209ae7ecabfbf083ff">tempest-ServerActionsTestOtherA-916478349-project-member</nova:user>
Aug 10 00:44:33 user nova-compute[73029]:         <nova:project uuid="60aabdbd31b647d68db993c0a60a43ec">tempest-ServerActionsTestOtherA-916478349</nova:project>
Aug 10 00:44:33 user nova-compute[73029]:       </nova:owner>
Aug 10 00:44:33 user nova-compute[73029]:       <nova:ports>
Aug 10 00:44:33 user nova-compute[73029]:         <nova:port uuid="24e98d91-db37-4730-97d2-f9fb3cf8c9a0">
Aug 10 00:44:33 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 10 00:44:33 user nova-compute[73029]:         </nova:port>
Aug 10 00:44:33 user nova-compute[73029]:       </nova:ports>
Aug 10 00:44:33 user nova-compute[73029]:     </nova:instance>
Aug 10 00:44:33 user nova-compute[73029]:   </metadata>
Aug 10 00:44:33 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:44:33 user nova-compute[73029]:     <system>
Aug 10 00:44:33 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:44:33 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:44:33 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:44:33 user nova-compute[73029]:       <entry name="serial">a759a046-b39b-4c7d-88ce-bf6922af5a81</entry>
Aug 10 00:44:33 user nova-compute[73029]:       <entry name="uuid">a759a046-b39b-4c7d-88ce-bf6922af5a81</entry>
Aug 10 00:44:33 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:44:33 user nova-compute[73029]:     </system>
Aug 10 00:44:33 user nova-compute[73029]:   </sysinfo>
Aug 10 00:44:33 user nova-compute[73029]:   <os>
Aug 10 00:44:33 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:44:33 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:44:33 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:44:33 user nova-compute[73029]:   </os>
Aug 10 00:44:33 user nova-compute[73029]:   <features>
Aug 10 00:44:33 user nova-compute[73029]:     <acpi/>
Aug 10 00:44:33 user nova-compute[73029]:     <apic/>
Aug 10 00:44:33 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:44:33 user nova-compute[73029]:   </features>
Aug 10 00:44:33 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:44:33 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:44:33 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:44:33 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:44:33 user nova-compute[73029]:   </clock>
Aug 10 00:44:33 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:44:33 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:44:33 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:44:33 user nova-compute[73029]:   </cpu>
Aug 10 00:44:33 user nova-compute[73029]:   <devices>
Aug 10 00:44:33 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:44:33 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:44:33 user nova-compute[73029]:       <source dev="/dev/sdc"/>
Aug 10 00:44:33 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:44:33 user nova-compute[73029]:       <serial>bb934ac5-976b-4e1f-8572-2a365db9d227</serial>
Aug 10 00:44:33 user nova-compute[73029]:     </disk>
Aug 10 00:44:33 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:44:33 user nova-compute[73029]:       <mac address="fa:16:3e:cf:99:04"/>
Aug 10 00:44:33 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:44:33 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:44:33 user nova-compute[73029]:       <target dev="tap24e98d91-db"/>
Aug 10 00:44:33 user nova-compute[73029]:     </interface>
Aug 10 00:44:33 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:44:33 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/a759a046-b39b-4c7d-88ce-bf6922af5a81/console.log" append="off"/>
Aug 10 00:44:33 user nova-compute[73029]:     </serial>
Aug 10 00:44:33 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:44:33 user nova-compute[73029]:     <video>
Aug 10 00:44:33 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:44:33 user nova-compute[73029]:     </video>
Aug 10 00:44:33 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:44:33 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:44:33 user nova-compute[73029]:     </rng>
Aug 10 00:44:33 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:44:33 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:44:33 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:44:33 user nova-compute[73029]:     </memballoon>
Aug 10 00:44:33 user nova-compute[73029]:   </devices>
Aug 10 00:44:33 user nova-compute[73029]: </domain>
Aug 10 00:44:33 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-774975152',display_name='tempest-ServerActionsTestOtherA-server-774975152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-774975152',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-6uqo1cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=a759a046-b39b-4c7d-88ce-bf6922af5a81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG os_vif [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24e98d91-db, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24e98d91-db, col_values=(('external_ids', {'iface-id': '24e98d91-db37-4730-97d2-f9fb3cf8c9a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:99:04', 'vm-uuid': 'a759a046-b39b-4c7d-88ce-bf6922af5a81'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:33 user nova-compute[73029]: INFO os_vif [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db')
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:44:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No VIF found with MAC fa:16:3e:cf:99:04, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-2035b82e-9565-4067-94d6-5d4c9d255927 req-0fc5ba09-6aea-4306-b705-9d72e7bc1c44 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2035b82e-9565-4067-94d6-5d4c9d255927 req-0fc5ba09-6aea-4306-b705-9d72e7bc1c44 service nova] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2035b82e-9565-4067-94d6-5d4c9d255927 req-0fc5ba09-6aea-4306-b705-9d72e7bc1c44 service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2035b82e-9565-4067-94d6-5d4c9d255927 req-0fc5ba09-6aea-4306-b705-9d72e7bc1c44 service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-2035b82e-9565-4067-94d6-5d4c9d255927 req-0fc5ba09-6aea-4306-b705-9d72e7bc1c44 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] No waiting events found dispatching network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:44:35 user nova-compute[73029]: WARNING nova.compute.manager [req-2035b82e-9565-4067-94d6-5d4c9d255927 req-0fc5ba09-6aea-4306-b705-9d72e7bc1c44 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received unexpected event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 for instance with vm_state building and task_state spawning.
Aug 10 00:44:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628277.611577, a759a046-b39b-4c7d-88ce-bf6922af5a81 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:44:37 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] VM Resumed (Lifecycle Event)
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:44:37 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Instance spawned successfully.
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:44:37 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628277.615159, a759a046-b39b-4c7d-88ce-bf6922af5a81 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:44:37 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] VM Started (Lifecycle Event)
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:44:37 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-fb8f1eba-c14b-4988-8ed9-c31ee6d477b9 req-441189dc-d9a4-44dd-ae9e-3994b31190e6 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fb8f1eba-c14b-4988-8ed9-c31ee6d477b9 req-441189dc-d9a4-44dd-ae9e-3994b31190e6 service nova] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fb8f1eba-c14b-4988-8ed9-c31ee6d477b9 req-441189dc-d9a4-44dd-ae9e-3994b31190e6 service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fb8f1eba-c14b-4988-8ed9-c31ee6d477b9 req-441189dc-d9a4-44dd-ae9e-3994b31190e6 service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-fb8f1eba-c14b-4988-8ed9-c31ee6d477b9 req-441189dc-d9a4-44dd-ae9e-3994b31190e6 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] No waiting events found dispatching network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:44:37 user nova-compute[73029]: WARNING nova.compute.manager [req-fb8f1eba-c14b-4988-8ed9-c31ee6d477b9 req-441189dc-d9a4-44dd-ae9e-3994b31190e6 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received unexpected event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 for instance with vm_state building and task_state spawning.
Aug 10 00:44:37 user nova-compute[73029]: INFO nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 10 00:44:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:44:37 user nova-compute[73029]: INFO nova.compute.manager [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Took 15.20 seconds to build instance.
Aug 10 00:44:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-981dfb60-0d1b-4174-a7f2-e265681c37b3 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.293s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:50 user nova-compute[73029]: INFO nova.compute.manager [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Rescuing
Aug 10 00:44:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:44:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquired lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:44:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:44:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG nova.network.neutron [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updating instance_info_cache with network_info: [{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Releasing lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-a9ddd5b6-a750-4d3c-a9ee-9d413b0d7ca4 req-8712c767-5b44-41c6-bf6f-a16ad5ddfdfb service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-unplugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a9ddd5b6-a750-4d3c-a9ee-9d413b0d7ca4 req-8712c767-5b44-41c6-bf6f-a16ad5ddfdfb service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a9ddd5b6-a750-4d3c-a9ee-9d413b0d7ca4 req-8712c767-5b44-41c6-bf6f-a16ad5ddfdfb service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a9ddd5b6-a750-4d3c-a9ee-9d413b0d7ca4 req-8712c767-5b44-41c6-bf6f-a16ad5ddfdfb service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-a9ddd5b6-a750-4d3c-a9ee-9d413b0d7ca4 req-8712c767-5b44-41c6-bf6f-a16ad5ddfdfb service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-unplugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:44:51 user nova-compute[73029]: WARNING nova.compute.manager [req-a9ddd5b6-a750-4d3c-a9ee-9d413b0d7ca4 req-8712c767-5b44-41c6-bf6f-a16ad5ddfdfb service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-unplugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state active and task_state rescuing.
Aug 10 00:44:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Instance destroyed successfully.
Aug 10 00:44:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Attempting rescue
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73029) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Instance directory exists: not creating {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 10 00:44:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Creating image(s)
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'trusted_certs' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.189s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue" returned: 0 in 0.056s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'migration_context' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Start _get_guest_xml network_info=[{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "vif_mac": "fa:16:3e:be:61:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'resources' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'numa_topology' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:44:52 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:44:52 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'vcpu_model' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-405003104',display_name='tempest-ServerRescueNegativeTestJSON-server-405003104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-405003104',id=16,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-9awclp1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:40:13Z,user_data=None,user_id='4a4fb6b058c64442b1688a3962849322',uuid=a2f85a2f-0bb4-4020-9260-98f866f5c9f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "vif_mac": "fa:16:3e:be:61:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "vif_mac": "fa:16:3e:be:61:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:61:2e,bridge_name='br-int',has_traffic_filtering=True,id=3eb034f0-40de-4c90-aaa8-5a9afdf3461c,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb034f0-40') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'pci_devices' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:44:52 user nova-compute[73029]:   <uuid>a2f85a2f-0bb4-4020-9260-98f866f5c9f6</uuid>
Aug 10 00:44:52 user nova-compute[73029]:   <name>instance-00000010</name>
Aug 10 00:44:52 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:44:52 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:44:52 user nova-compute[73029]:   <metadata>
Aug 10 00:44:52 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:44:52 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:44:52 user nova-compute[73029]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-405003104</nova:name>
Aug 10 00:44:52 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:44:52</nova:creationTime>
Aug 10 00:44:52 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:44:52 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:44:52 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:44:52 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:44:52 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:44:52 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:44:52 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:44:52 user nova-compute[73029]:       <nova:owner>
Aug 10 00:44:52 user nova-compute[73029]:         <nova:user uuid="4a4fb6b058c64442b1688a3962849322">tempest-ServerRescueNegativeTestJSON-1160585559-project-member</nova:user>
Aug 10 00:44:52 user nova-compute[73029]:         <nova:project uuid="e54d7ee7b2c741e2bbc4a1fb4a2cc042">tempest-ServerRescueNegativeTestJSON-1160585559</nova:project>
Aug 10 00:44:52 user nova-compute[73029]:       </nova:owner>
Aug 10 00:44:52 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:44:52 user nova-compute[73029]:       <nova:ports>
Aug 10 00:44:52 user nova-compute[73029]:         <nova:port uuid="3eb034f0-40de-4c90-aaa8-5a9afdf3461c">
Aug 10 00:44:52 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 10 00:44:52 user nova-compute[73029]:         </nova:port>
Aug 10 00:44:52 user nova-compute[73029]:       </nova:ports>
Aug 10 00:44:52 user nova-compute[73029]:     </nova:instance>
Aug 10 00:44:52 user nova-compute[73029]:   </metadata>
Aug 10 00:44:52 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:44:52 user nova-compute[73029]:     <system>
Aug 10 00:44:52 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:44:52 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:44:52 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:44:52 user nova-compute[73029]:       <entry name="serial">a2f85a2f-0bb4-4020-9260-98f866f5c9f6</entry>
Aug 10 00:44:52 user nova-compute[73029]:       <entry name="uuid">a2f85a2f-0bb4-4020-9260-98f866f5c9f6</entry>
Aug 10 00:44:52 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:44:52 user nova-compute[73029]:     </system>
Aug 10 00:44:52 user nova-compute[73029]:   </sysinfo>
Aug 10 00:44:52 user nova-compute[73029]:   <os>
Aug 10 00:44:52 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:44:52 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:44:52 user nova-compute[73029]:   </os>
Aug 10 00:44:52 user nova-compute[73029]:   <features>
Aug 10 00:44:52 user nova-compute[73029]:     <acpi/>
Aug 10 00:44:52 user nova-compute[73029]:     <apic/>
Aug 10 00:44:52 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:44:52 user nova-compute[73029]:   </features>
Aug 10 00:44:52 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:44:52 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:44:52 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:44:52 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:44:52 user nova-compute[73029]:   </clock>
Aug 10 00:44:52 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:44:52 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:44:52 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:44:52 user nova-compute[73029]:   </cpu>
Aug 10 00:44:52 user nova-compute[73029]:   <devices>
Aug 10 00:44:52 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:44:52 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:44:52 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue"/>
Aug 10 00:44:52 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:44:52 user nova-compute[73029]:     </disk>
Aug 10 00:44:52 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:44:52 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:44:52 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk"/>
Aug 10 00:44:52 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:44:52 user nova-compute[73029]:     </disk>
Aug 10 00:44:52 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:44:52 user nova-compute[73029]:       <mac address="fa:16:3e:be:61:2e"/>
Aug 10 00:44:52 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:44:52 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:44:52 user nova-compute[73029]:       <target dev="tap3eb034f0-40"/>
Aug 10 00:44:52 user nova-compute[73029]:     </interface>
Aug 10 00:44:52 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:44:52 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/console.log" append="off"/>
Aug 10 00:44:52 user nova-compute[73029]:     </serial>
Aug 10 00:44:52 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:44:52 user nova-compute[73029]:     <video>
Aug 10 00:44:52 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:44:52 user nova-compute[73029]:     </video>
Aug 10 00:44:52 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:44:52 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:44:52 user nova-compute[73029]:     </rng>
Aug 10 00:44:52 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:44:52 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:44:52 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:44:52 user nova-compute[73029]:     </memballoon>
Aug 10 00:44:52 user nova-compute[73029]:   </devices>
Aug 10 00:44:52 user nova-compute[73029]: </domain>
Aug 10 00:44:52 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:44:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Instance destroyed successfully.
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:44:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No VIF found with MAC fa:16:3e:be:61:2e, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:44:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-f141d9fa-0530-48d7-926e-1e6479d420e8 req-431f4ede-3d09-411e-8804-3e1f46247188 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:44:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f141d9fa-0530-48d7-926e-1e6479d420e8 req-431f4ede-3d09-411e-8804-3e1f46247188 service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f141d9fa-0530-48d7-926e-1e6479d420e8 req-431f4ede-3d09-411e-8804-3e1f46247188 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f141d9fa-0530-48d7-926e-1e6479d420e8 req-431f4ede-3d09-411e-8804-3e1f46247188 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-f141d9fa-0530-48d7-926e-1e6479d420e8 req-431f4ede-3d09-411e-8804-3e1f46247188 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:44:53 user nova-compute[73029]: WARNING nova.compute.manager [req-f141d9fa-0530-48d7-926e-1e6479d420e8 req-431f4ede-3d09-411e-8804-3e1f46247188 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state active and task_state rescuing.
Aug 10 00:44:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG nova.objects.instance [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'flavor' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:54 user nova-compute[73029]: INFO nova.compute.manager [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Attaching volume efab513d-9a6c-4422-8efc-501492f13fa4 to /dev/vdb
Aug 10 00:44:55 user nova-compute[73029]: DEBUG os_brick.utils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ffb821-b111-4bd6-913d-9c38c3449f75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[744d473d-fb42-4037-b0b9-c3ed8b726e81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c46410c-ec25-4bca-a248-f3703879cb96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba0df3e-f7dd-4119-b1ee-359cc4a24078]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:44:55 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dd78ef-bfe3-476a-965b-85f862abddb3]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG os_brick.utils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating existing volume attachment record: bbf21a58-0f6d-4b79-bb02-444b4d856977 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:44:55 user nova-compute[73029]: WARNING nova.compute.manager [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state active and task_state rescuing.
Aug 10 00:44:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:44:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:44:55 user nova-compute[73029]: WARNING nova.compute.manager [req-8f403e9d-aba5-40e3-a46f-31a812049187 req-c239b7dd-fcce-4a34-b082-45f41fe30baf service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state active and task_state rescuing.
Aug 10 00:44:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for a2f85a2f-0bb4-4020-9260-98f866f5c9f6 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:44:56 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628296.6125739, a2f85a2f-0bb4-4020-9260-98f866f5c9f6 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:44:56 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] VM Resumed (Lifecycle Event)
Aug 10 00:44:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-52c4d5b8-5765-4b34-9b0f-15459126634c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:44:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:44:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:44:56 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 10 00:44:56 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628296.6132042, a2f85a2f-0bb4-4020-9260-98f866f5c9f6 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:44:56 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] VM Started (Lifecycle Event)
Aug 10 00:44:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:44:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:44:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:44:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMrstOln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:45:03 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:03 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:03 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b445f4-492c-49ae-b123-ebdbce37f7de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:45:03 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f43b38-40f3-49ba-bb3d-6e6f54ad11ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121] added
Aug 10 00:45:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd569cb8-1d83-4fd6-89aa-e196d736ba7a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd995301-0db3-4cd8-a892-11734f3fc4c2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMrstOln {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMrstOln" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5a409b-c1ec-40f5-98f7-b6ded9a0551c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uMrstOln'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d0317-fcc7-4979-9c3e-b1c4eaf76364]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26fc6f6-4286-4337-a4cd-f59ffc2e8eac]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:03 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:03 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d47fa8-092a-4929-aee5-761678a0afe0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121, portal: 172.16.0.220,3260]
Aug 10 00:45:04 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121, portal: 172.16.0.220,3260] successful.
Aug 10 00:45:04 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfaa5cf-56b0-4574-9e45-d1a8d1f6ffe7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1c22df-9413-430d-8784-5e2435995931]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:04 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:04 user nova-compute[73029]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)
Aug 10 00:45:04 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:04 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:04 user nova-compute[73029]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)
Aug 10 00:45:04 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5580da1e-996b-4237-85fe-8b6bd8f6d90e]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:45:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMrstOln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26664346261363635', 'path': '/dev/sdd'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664346261363635', 'path': '/dev/sdd'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG nova.objects.instance [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'flavor' on Instance uuid 889d1049-c384-4ad3-837c-4c739f345e1c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:45:05 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:45:05 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:45:05 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:45:05 user nova-compute[73029]:   <serial>99229cf9-bda7-451e-afb2-b36023533121</serial>
Aug 10 00:45:05 user nova-compute[73029]: </disk>
Aug 10 00:45:05 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:45:05 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:05 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:05 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8890a00c-ef00-4852-a93c-b316fb94fbe3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:45:05 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd835f3-2537-46f2-b07c-541d282ec39a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4] added
Aug 10 00:45:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc688b3-fcd0-4415-8c1a-6b44cd66fc98]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[675597bf-43a3-47e9-a8ed-8fece0f7b381]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjLUxpTM {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjLUxpTM" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f16d0e-8a7f-48d3-b115-71dcf3c57d7d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjLUxpTM'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f441c8-67e9-48f6-8ce0-22d1f1a8d3f0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46d950-9919-43db-8366-941e7a2624f5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No VIF found with MAC fa:16:3e:22:31:02, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c8f84a-911a-48f9-b8e8-b064e1c3222d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]
Aug 10 00:45:05 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.
Aug 10 00:45:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[625eed08-3a2f-49d3-953f-238928a24623]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade98fc2-65a3-4151-aca1-8d36dd56fd7a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:45:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[50621694-ddf5-4859-9fcb-b82fab58f9ba]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:45:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-835f7b74-c7fc-4449-8f2b-5defe0ed1a6f tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.891s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23639313237316231', 'path': '/dev/sde'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:45:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639313237316231', 'path': '/dev/sde'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:45:06 user nova-compute[73029]: DEBUG nova.objects.instance [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'flavor' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:45:06 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:45:06 user nova-compute[73029]:   <source dev="/dev/sde"/>
Aug 10 00:45:06 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:45:06 user nova-compute[73029]:   <serial>efab513d-9a6c-4422-8efc-501492f13fa4</serial>
Aug 10 00:45:06 user nova-compute[73029]: </disk>
Aug 10 00:45:06 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:45:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:45:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:45:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] No VIF found with MAC fa:16:3e:6b:32:5a, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:45:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c56-1786-4161-b2e8-3a8d4be5405e tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.684s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:07 user nova-compute[73029]: INFO nova.compute.manager [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Detaching volume 99229cf9-bda7-451e-afb2-b36023533121
Aug 10 00:45:07 user nova-compute[73029]: INFO nova.virt.block_device [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Attempting to driver detach volume 99229cf9-bda7-451e-afb2-b36023533121 from mountpoint /dev/vdb
Aug 10 00:45:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Attempting to detach device vdb from instance 889d1049-c384-4ad3-837c-4c739f345e1c from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:45:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:45:07 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:45:07 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:45:07 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:45:07 user nova-compute[73029]:   <serial>99229cf9-bda7-451e-afb2-b36023533121</serial>
Aug 10 00:45:07 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:45:07 user nova-compute[73029]: </disk>
Aug 10 00:45:07 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:45:07 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully detached device vdb from instance 889d1049-c384-4ad3-837c-4c739f345e1c from the persistent domain config.
Aug 10 00:45:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 889d1049-c384-4ad3-837c-4c739f345e1c from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:45:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:45:07 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:45:07 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:45:07 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:45:07 user nova-compute[73029]:   <serial>99229cf9-bda7-451e-afb2-b36023533121</serial>
Aug 10 00:45:07 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:45:07 user nova-compute[73029]: </disk>
Aug 10 00:45:07 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628308.3968503, 889d1049-c384-4ad3-837c-4c739f345e1c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 889d1049-c384-4ad3-837c-4c739f345e1c {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:45:08 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully detached device vdb from instance 889d1049-c384-4ad3-837c-4c739f345e1c from the live domain config.
Aug 10 00:45:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMrstOln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:45:08 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[df52397d-d7d0-41c9-ba70-157fe81fc8b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4d785-2403-4810-9135-1723a7d875e3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:08 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:08 user nova-compute[73029]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)
Aug 10 00:45:08 user nova-compute[73029]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:45:08 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:08 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:08 user nova-compute[73029]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 (non-flash)
Aug 10 00:45:08 user nova-compute[73029]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:45:08 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7514190040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121'): ({'sdd'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Removing single pathed devices sdd {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47e3331-40a0-4c00-9f38-ab18a7cfbd7e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b68780-fb83-4169-a35b-bf08864ba7ef]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flushing IO for device /dev/sdd {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.033s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4f9168-6cca-4e85-b91e-86c61976d4fe]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d6f52a-f79d-4941-b8ef-1d6a5939ade2]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[02561b54-fe40-4846-bdfb-9bf2aa199d48]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7658818-d7dd-4cde-9565-bde2406375c8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121, portal: 172.16.0.220,3260]
Aug 10 00:45:08 user nova-compute[73029]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121, portal: 172.16.0.220,3260] successful.
Aug 10 00:45:08 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99229cf9-bda7-451e-afb2-b36023533121 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[716ba7f5-bcb6-4540-89e4-3ce2f00b3fa7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] <== disconnect_volume: return (353ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:45:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:09 user nova-compute[73029]: DEBUG nova.objects.instance [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'flavor' on Instance uuid 889d1049-c384-4ad3-837c-4c739f345e1c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-393b8805-c9b6-467d-bf6c-6716966c2498 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.379s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Stashing vm_state: active {{(pid=73029) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 10 00:45:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'pci_requests' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:10 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:45:10 user nova-compute[73029]: INFO nova.compute.claims [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Claim successful on node user
Aug 10 00:45:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'resources' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'pci_devices' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:10 user nova-compute[73029]: INFO nova.compute.resource_tracker [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating resource usage from migration e13e83d3-6c8b-4c71-afb0-f0af16f06f45
Aug 10 00:45:11 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:45:11 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:45:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.649s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:11 user nova-compute[73029]: INFO nova.compute.manager [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Migrating
Aug 10 00:45:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:11 user nova-compute[73029]: INFO nova.compute.rpcapi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 10 00:45:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquired lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:11 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:45:11 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance_info_cache with network_info: [{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Releasing lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Starting migrate_disk_and_power_off {{(pid=73029) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-f76d6f96-6c8e-46f0-bef2-25498ec0ddfc req-14983e6b-0da7-4579-b4d1-b16e0b234e9a service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-unplugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f76d6f96-6c8e-46f0-bef2-25498ec0ddfc req-14983e6b-0da7-4579-b4d1-b16e0b234e9a service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f76d6f96-6c8e-46f0-bef2-25498ec0ddfc req-14983e6b-0da7-4579-b4d1-b16e0b234e9a service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f76d6f96-6c8e-46f0-bef2-25498ec0ddfc req-14983e6b-0da7-4579-b4d1-b16e0b234e9a service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-f76d6f96-6c8e-46f0-bef2-25498ec0ddfc req-14983e6b-0da7-4579-b4d1-b16e0b234e9a service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-unplugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:45:12 user nova-compute[73029]: WARNING nova.compute.manager [req-f76d6f96-6c8e-46f0-bef2-25498ec0ddfc req-14983e6b-0da7-4579-b4d1-b16e0b234e9a service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-unplugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state active and task_state resize_migrating.
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance destroyed successfully.
Aug 10 00:45:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-269092502',display_name='tempest-ServerActionsTestOtherB-server-269092502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-269092502',id=19,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItzikrNamyVCnXNCeYWOUlFND2bQ8Tuk4qPbQ4GANcUlImEfJj3KUpqnSakA5oCLo1HOK7tJ0c86mCVYnqC3w/Zcx+l5l4Z97MDUOsNoNFHs+ZvBbIlKUjuqYy9iRb8Lw==',key_name='tempest-keypair-1753578335',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74ad7b2647e5407b89ce46595c1fc9e8',ramdisk_id='',reservation_id='r-e1uzv60r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539813810',owner_user_name='tempest-ServerActionsTestOtherB-539813810-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:45:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1bb9034314565893a8d3629f8cd0c',uuid=c4da58fe-aaf3-413d-aa56-48cf53e3a1d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-817317076-network", "vif_mac": "fa:16:3e:6b:32:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converting VIF {"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-817317076-network", "vif_mac": "fa:16:3e:6b:32:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG os_vif [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e775285-84, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:45:12 user nova-compute[73029]: INFO os_vif [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84')
Aug 10 00:45:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:45:12 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:45:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee4c74e-0fcf-4966-a272-41f8c51f4dc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d58fa1-99f0-482d-853b-fbc0a169f840]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:13 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:13 user nova-compute[73029]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:45:13 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:13 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:13 user nova-compute[73029]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:45:13 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141bcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'): ({'sde'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Removing single pathed devices sde {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe8eec7-1258-4a38-a57b-5d4c906b063c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[14acf7e2-f55d-44ed-9ee7-b4273988f471]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Flushing IO for device /dev/sde {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[735d22f6-9f21-4f27-8c08-093ec4276c0c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[78db0306-c481-4889-bfb8-42f756b6b08f]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] SCSI volumes sde have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[20af2b0d-f52b-4425-928c-c2aa5456ac7a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd120b6-c36d-47e5-859e-f577a80a8a42]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]
Aug 10 00:45:13 user nova-compute[73029]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.
Aug 10 00:45:13 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c4ff1-2f17-460f-9a95-954e23580cec]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] <== disconnect_volume: return (317ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:45:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5_resize/disk /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "cp -r /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5_resize/disk /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk" returned: 0 in 0.478s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5_resize/disk.info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk.info {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "cp -r /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5_resize/disk.info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk.info" returned: 0 in 0.037s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:45:14 user nova-compute[73029]: INFO nova.compute.claims [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Claim successful on node user
Aug 10 00:45:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-5133651b-acc8-4a35-b7ed-2a38a1a66576 req-75bdca82-1152-4261-85c8-27baf083b84c service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5133651b-acc8-4a35-b7ed-2a38a1a66576 req-75bdca82-1152-4261-85c8-27baf083b84c service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5133651b-acc8-4a35-b7ed-2a38a1a66576 req-75bdca82-1152-4261-85c8-27baf083b84c service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5133651b-acc8-4a35-b7ed-2a38a1a66576 req-75bdca82-1152-4261-85c8-27baf083b84c service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-5133651b-acc8-4a35-b7ed-2a38a1a66576 req-75bdca82-1152-4261-85c8-27baf083b84c service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:45:14 user nova-compute[73029]: WARNING nova.compute.manager [req-5133651b-acc8-4a35-b7ed-2a38a1a66576 req-75bdca82-1152-4261-85c8-27baf083b84c service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state active and task_state resize_migrating.
Aug 10 00:45:14 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.network.neutron [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:45:15 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.policy [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d53b55b655a471aa70b5a0a58d43300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2885b7b1a88442a38a8c9a69a9234bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:45:15 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Creating image(s)
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "/opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "/opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "/opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:45:15 user nova-compute[73029]: INFO nova.compute.claims [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Claim successful on node user
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.166s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Port 7e775285-84c8-4049-9914-d6b201090b0a binding to destination host user is already ACTIVE {{(pid=73029) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.176s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk 1073741824" returned: 0 in 0.054s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Cannot resize image /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.objects.instance [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lazy-loading 'migration_context' on Instance uuid 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Ensure instance console log exists: /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:45:16 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:45:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:45:16 user nova-compute[73029]: INFO nova.virt.block_device [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Booting with volume e6cae31c-7aeb-4937-9ac3-38b62c30c710 at /dev/vda
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquired lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG os_brick.utils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d39f7c-0b6d-4f51-8d82-a1d65a9af84c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f35f10c-0b54-4fd1-bc8c-bd317d08548d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[add0744e-6c76-4ba7-980f-0135079e2c37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5893c75-102c-4289-a2b8-65c8d69be2b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:45:16 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:45:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af87fe-53d3-4278-8570-b88e96262572]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG os_brick.utils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Updating existing volume attachment record: c2b309d2-3a46-4ff9-8660-a85d0b309520 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG nova.policy [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28a10069ba1b486491a647c7aaec3324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07258fd0d1784a0584f05238888556d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:45:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Successfully created port: 4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance_info_cache with network_info: [{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Releasing lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG os_brick.utils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7839429e-bd44-4425-9e16-50d89e70870b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65071c9-12b4-4d3f-8573-cd7bc85cff7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da429f3-2a71-4ef6-bd60-cc52e8e2b58b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa932d3-a0c9-41ff-827e-4346356030ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:45:17 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:45:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1801542c-ea55-47ce-9869-f7d5c38620aa]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG os_brick.utils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:45:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Successfully created port: 969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Successfully updated port: 4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "refresh_cache-655f9889-40ea-416f-9df2-71838819c37b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquired lock "refresh_cache-655f9889-40ea-416f-9df2-71838819c37b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-53f0f49f-a988-4507-b524-64aa3b8d5013 req-3720e41d-94f1-4502-a3ea-f63a2a4baeba service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received event network-changed-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-53f0f49f-a988-4507-b524-64aa3b8d5013 req-3720e41d-94f1-4502-a3ea-f63a2a4baeba service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Refreshing instance network info cache due to event network-changed-4f8428d8-a469-452c-8218-cc53ca757d7b. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-53f0f49f-a988-4507-b524-64aa3b8d5013 req-3720e41d-94f1-4502-a3ea-f63a2a4baeba service nova] Acquiring lock "refresh_cache-655f9889-40ea-416f-9df2-71838819c37b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Updating instance_info_cache with network_info: [{"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Releasing lock "refresh_cache-655f9889-40ea-416f-9df2-71838819c37b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Instance network_info: |[{"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-53f0f49f-a988-4507-b524-64aa3b8d5013 req-3720e41d-94f1-4502-a3ea-f63a2a4baeba service nova] Acquired lock "refresh_cache-655f9889-40ea-416f-9df2-71838819c37b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-53f0f49f-a988-4507-b524-64aa3b8d5013 req-3720e41d-94f1-4502-a3ea-f63a2a4baeba service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Refreshing network info cache for port 4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Start _get_guest_xml network_info=[{"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:45:19 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:45:19 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-89052549',display_name='tempest-TestServerVolumeAttachmentScenario-server-89052549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-89052549',id=24,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxqIFf9zpniq+PHxc3zzdDiI95WW55vSdGSLEQpOjjMYumSAlwY32RS4yevMGaQ/SpaGP0pZ+boEPVHa0ldwVqTU8lVX+c8/GFz6AZ4k34zMFlLlrneVdUavDQheF1mlQ==',key_name='tempest-keypair-579326169',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2885b7b1a88442a38a8c9a69a9234bff',ramdisk_id='',reservation_id='r-2njcbegw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-954433369',owner_user_name='tempest-TestServerVolumeAttachmentScenario-954433369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d53b55b655a471aa70b5a0a58d43300',uuid=655f9889-40ea-416f-9df2-71838819c37b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Converting VIF {"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:83:00,bridge_name='br-int',has_traffic_filtering=True,id=4f8428d8-a469-452c-8218-cc53ca757d7b,network=Network(567e3543-925a-4428-894f-5c2999e4c93e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8428d8-a4') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.objects.instance [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lazy-loading 'pci_devices' on Instance uuid 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:45:19 user nova-compute[73029]:   <uuid>655f9889-40ea-416f-9df2-71838819c37b</uuid>
Aug 10 00:45:19 user nova-compute[73029]:   <name>instance-00000018</name>
Aug 10 00:45:19 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:45:19 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:45:19 user nova-compute[73029]:   <metadata>
Aug 10 00:45:19 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:45:19 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:45:19 user nova-compute[73029]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-89052549</nova:name>
Aug 10 00:45:19 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:45:19</nova:creationTime>
Aug 10 00:45:19 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:45:19 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:45:19 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:45:19 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:45:19 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:45:19 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:45:19 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:45:19 user nova-compute[73029]:       <nova:owner>
Aug 10 00:45:19 user nova-compute[73029]:         <nova:user uuid="6d53b55b655a471aa70b5a0a58d43300">tempest-TestServerVolumeAttachmentScenario-954433369-project-member</nova:user>
Aug 10 00:45:19 user nova-compute[73029]:         <nova:project uuid="2885b7b1a88442a38a8c9a69a9234bff">tempest-TestServerVolumeAttachmentScenario-954433369</nova:project>
Aug 10 00:45:19 user nova-compute[73029]:       </nova:owner>
Aug 10 00:45:19 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:45:19 user nova-compute[73029]:       <nova:ports>
Aug 10 00:45:19 user nova-compute[73029]:         <nova:port uuid="4f8428d8-a469-452c-8218-cc53ca757d7b">
Aug 10 00:45:19 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 10 00:45:19 user nova-compute[73029]:         </nova:port>
Aug 10 00:45:19 user nova-compute[73029]:       </nova:ports>
Aug 10 00:45:19 user nova-compute[73029]:     </nova:instance>
Aug 10 00:45:19 user nova-compute[73029]:   </metadata>
Aug 10 00:45:19 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:45:19 user nova-compute[73029]:     <system>
Aug 10 00:45:19 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:45:19 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:45:19 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:45:19 user nova-compute[73029]:       <entry name="serial">655f9889-40ea-416f-9df2-71838819c37b</entry>
Aug 10 00:45:19 user nova-compute[73029]:       <entry name="uuid">655f9889-40ea-416f-9df2-71838819c37b</entry>
Aug 10 00:45:19 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:45:19 user nova-compute[73029]:     </system>
Aug 10 00:45:19 user nova-compute[73029]:   </sysinfo>
Aug 10 00:45:19 user nova-compute[73029]:   <os>
Aug 10 00:45:19 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:45:19 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:45:19 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:45:19 user nova-compute[73029]:   </os>
Aug 10 00:45:19 user nova-compute[73029]:   <features>
Aug 10 00:45:19 user nova-compute[73029]:     <acpi/>
Aug 10 00:45:19 user nova-compute[73029]:     <apic/>
Aug 10 00:45:19 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:45:19 user nova-compute[73029]:   </features>
Aug 10 00:45:19 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:45:19 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:45:19 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:45:19 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:45:19 user nova-compute[73029]:   </clock>
Aug 10 00:45:19 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:45:19 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:45:19 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:45:19 user nova-compute[73029]:   </cpu>
Aug 10 00:45:19 user nova-compute[73029]:   <devices>
Aug 10 00:45:19 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:45:19 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:45:19 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk"/>
Aug 10 00:45:19 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:45:19 user nova-compute[73029]:     </disk>
Aug 10 00:45:19 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:45:19 user nova-compute[73029]:       <mac address="fa:16:3e:13:83:00"/>
Aug 10 00:45:19 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:45:19 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:45:19 user nova-compute[73029]:       <target dev="tap4f8428d8-a4"/>
Aug 10 00:45:19 user nova-compute[73029]:     </interface>
Aug 10 00:45:19 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:45:19 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/console.log" append="off"/>
Aug 10 00:45:19 user nova-compute[73029]:     </serial>
Aug 10 00:45:19 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:45:19 user nova-compute[73029]:     <video>
Aug 10 00:45:19 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:45:19 user nova-compute[73029]:     </video>
Aug 10 00:45:19 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:45:19 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:45:19 user nova-compute[73029]:     </rng>
Aug 10 00:45:19 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:45:19 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:45:19 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:45:19 user nova-compute[73029]:     </memballoon>
Aug 10 00:45:19 user nova-compute[73029]:   </devices>
Aug 10 00:45:19 user nova-compute[73029]: </domain>
Aug 10 00:45:19 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-89052549',display_name='tempest-TestServerVolumeAttachmentScenario-server-89052549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-89052549',id=24,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxqIFf9zpniq+PHxc3zzdDiI95WW55vSdGSLEQpOjjMYumSAlwY32RS4yevMGaQ/SpaGP0pZ+boEPVHa0ldwVqTU8lVX+c8/GFz6AZ4k34zMFlLlrneVdUavDQheF1mlQ==',key_name='tempest-keypair-579326169',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2885b7b1a88442a38a8c9a69a9234bff',ramdisk_id='',reservation_id='r-2njcbegw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-954433369',owner_user_name='tempest-TestServerVolumeAttachmentScenario-954433369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d53b55b655a471aa70b5a0a58d43300',uuid=655f9889-40ea-416f-9df2-71838819c37b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Converting VIF {"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:83:00,bridge_name='br-int',has_traffic_filtering=True,id=4f8428d8-a469-452c-8218-cc53ca757d7b,network=Network(567e3543-925a-4428-894f-5c2999e4c93e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8428d8-a4') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG os_vif [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:83:00,bridge_name='br-int',has_traffic_filtering=True,id=4f8428d8-a469-452c-8218-cc53ca757d7b,network=Network(567e3543-925a-4428-894f-5c2999e4c93e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8428d8-a4') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f8428d8-a4, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f8428d8-a4, col_values=(('external_ids', {'iface-id': '4f8428d8-a469-452c-8218-cc53ca757d7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:83:00', 'vm-uuid': '655f9889-40ea-416f-9df2-71838819c37b'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:19 user nova-compute[73029]: INFO os_vif [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:83:00,bridge_name='br-int',has_traffic_filtering=True,id=4f8428d8-a469-452c-8218-cc53ca757d7b,network=Network(567e3543-925a-4428-894f-5c2999e4c93e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8428d8-a4')
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] No VIF found with MAC fa:16:3e:13:83:00, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updating instance_info_cache with network_info: [{"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Successfully updated port: 969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "refresh_cache-87bdf189-555c-4bf1-85cb-b5eed3753dca" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquired lock "refresh_cache-87bdf189-555c-4bf1-85cb-b5eed3753dca" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-03864cbd-bf09-4ecd-8aa8-c5b4a44ae31a req-e2e435d7-4420-4284-84a8-ad524324d930 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-changed-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-03864cbd-bf09-4ecd-8aa8-c5b4a44ae31a req-e2e435d7-4420-4284-84a8-ad524324d930 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Refreshing instance network info cache due to event network-changed-969e1ff4-cb79-4f35-9121-d34f9ef7849d. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-03864cbd-bf09-4ecd-8aa8-c5b4a44ae31a req-e2e435d7-4420-4284-84a8-ad524324d930 service nova] Acquiring lock "refresh_cache-87bdf189-555c-4bf1-85cb-b5eed3753dca" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG nova.network.neutron [req-53f0f49f-a988-4507-b524-64aa3b8d5013 req-3720e41d-94f1-4502-a3ea-f63a2a4baeba service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Updated VIF entry in instance network info cache for port 4f8428d8-a469-452c-8218-cc53ca757d7b. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG nova.network.neutron [req-53f0f49f-a988-4507-b524-64aa3b8d5013 req-3720e41d-94f1-4502-a3ea-f63a2a4baeba service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Updating instance_info_cache with network_info: [{"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-53f0f49f-a988-4507-b524-64aa3b8d5013 req-3720e41d-94f1-4502-a3ea-f63a2a4baeba service nova] Releasing lock "refresh_cache-655f9889-40ea-416f-9df2-71838819c37b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Updating instance_info_cache with network_info: [{"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Releasing lock "refresh_cache-87bdf189-555c-4bf1-85cb-b5eed3753dca" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance network_info: |[{"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:45:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-03864cbd-bf09-4ecd-8aa8-c5b4a44ae31a req-e2e435d7-4420-4284-84a8-ad524324d930 service nova] Acquired lock "refresh_cache-87bdf189-555c-4bf1-85cb-b5eed3753dca" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-03864cbd-bf09-4ecd-8aa8-c5b4a44ae31a req-e2e435d7-4420-4284-84a8-ad524324d930 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Refreshing network info cache for port 969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:45:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-03864cbd-bf09-4ecd-8aa8-c5b4a44ae31a req-e2e435d7-4420-4284-84a8-ad524324d930 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Updated VIF entry in instance network info cache for port 969e1ff4-cb79-4f35-9121-d34f9ef7849d. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-03864cbd-bf09-4ecd-8aa8-c5b4a44ae31a req-e2e435d7-4420-4284-84a8-ad524324d930 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Updating instance_info_cache with network_info: [{"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-03864cbd-bf09-4ecd-8aa8-c5b4a44ae31a req-e2e435d7-4420-4284-84a8-ad524324d930 service nova] Releasing lock "refresh_cache-87bdf189-555c-4bf1-85cb-b5eed3753dca" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received event network-vif-plugged-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] No waiting events found dispatching network-vif-plugged-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:45:22 user nova-compute[73029]: WARNING nova.compute.manager [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received unexpected event network-vif-plugged-4f8428d8-a469-452c-8218-cc53ca757d7b for instance with vm_state building and task_state spawning.
Aug 10 00:45:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received event network-vif-plugged-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] No waiting events found dispatching network-vif-plugged-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:45:22 user nova-compute[73029]: WARNING nova.compute.manager [req-663a43d7-2db6-48dd-abb6-c80c322b2f75 req-3990d16a-5964-4033-b5d3-14d40fc64f6b service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received unexpected event network-vif-plugged-4f8428d8-a469-452c-8218-cc53ca757d7b for instance with vm_state building and task_state spawning.
Aug 10 00:45:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-0968b1fc-9310-43a5-84f3-7b2a149567aa req-46ecdaa5-7625-4356-8a8a-c39d20aa6654 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-0968b1fc-9310-43a5-84f3-7b2a149567aa req-46ecdaa5-7625-4356-8a8a-c39d20aa6654 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing instance network info cache due to event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0968b1fc-9310-43a5-84f3-7b2a149567aa req-46ecdaa5-7625-4356-8a8a-c39d20aa6654 service nova] Acquiring lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0968b1fc-9310-43a5-84f3-7b2a149567aa req-46ecdaa5-7625-4356-8a8a-c39d20aa6654 service nova] Acquired lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-0968b1fc-9310-43a5-84f3-7b2a149567aa req-46ecdaa5-7625-4356-8a8a-c39d20aa6654 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.network.neutron [req-0968b1fc-9310-43a5-84f3-7b2a149567aa req-46ecdaa5-7625-4356-8a8a-c39d20aa6654 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updated VIF entry in instance network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.network.neutron [req-0968b1fc-9310-43a5-84f3-7b2a149567aa req-46ecdaa5-7625-4356-8a8a-c39d20aa6654 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updating instance_info_cache with network_info: [{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0968b1fc-9310-43a5-84f3-7b2a149567aa req-46ecdaa5-7625-4356-8a8a-c39d20aa6654 service nova] Releasing lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628323.5422223, 655f9889-40ea-416f-9df2-71838819c37b => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:45:23 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 655f9889-40ea-416f-9df2-71838819c37b] VM Resumed (Lifecycle Event)
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:45:23 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Instance spawned successfully.
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:23 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 655f9889-40ea-416f-9df2-71838819c37b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628323.543305, 655f9889-40ea-416f-9df2-71838819c37b => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:45:23 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 655f9889-40ea-416f-9df2-71838819c37b] VM Started (Lifecycle Event)
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:45:23 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 655f9889-40ea-416f-9df2-71838819c37b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:45:23 user nova-compute[73029]: INFO nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Took 8.46 seconds to spawn the instance on the hypervisor.
Aug 10 00:45:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:45:23 user nova-compute[73029]: INFO nova.compute.manager [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Took 9.28 seconds to build instance.
Aug 10 00:45:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-62ce66b4-21c7-4cc8-a4ae-8eaa6035d65e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.496s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:24 user nova-compute[73029]: INFO nova.compute.manager [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Detaching volume 1af2a0ff-56b7-44a7-b563-7cd4155d8eb7
Aug 10 00:45:24 user nova-compute[73029]: INFO nova.virt.block_device [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Attempting to driver detach volume 1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 from mountpoint /dev/vdb
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Attempting to detach device vdb from instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:45:24 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:45:24 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:45:24 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:45:24 user nova-compute[73029]:   <serial>1af2a0ff-56b7-44a7-b563-7cd4155d8eb7</serial>
Aug 10 00:45:24 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 10 00:45:24 user nova-compute[73029]: </disk>
Aug 10 00:45:24 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:45:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully detached device vdb from instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d from the persistent domain config.
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:45:24 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:45:24 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:45:24 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:45:24 user nova-compute[73029]:   <serial>1af2a0ff-56b7-44a7-b563-7cd4155d8eb7</serial>
Aug 10 00:45:24 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 10 00:45:24 user nova-compute[73029]: </disk>
Aug 10 00:45:24 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-30971286-d791-42f2-98f5-da0e13c15092 req-acfa7a49-2927-4f9e-ba5b-e6e0dde04d4a service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-30971286-d791-42f2-98f5-da0e13c15092 req-acfa7a49-2927-4f9e-ba5b-e6e0dde04d4a service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing instance network info cache due to event network-changed-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-30971286-d791-42f2-98f5-da0e13c15092 req-acfa7a49-2927-4f9e-ba5b-e6e0dde04d4a service nova] Acquiring lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-30971286-d791-42f2-98f5-da0e13c15092 req-acfa7a49-2927-4f9e-ba5b-e6e0dde04d4a service nova] Acquired lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.network.neutron [req-30971286-d791-42f2-98f5-da0e13c15092 req-acfa7a49-2927-4f9e-ba5b-e6e0dde04d4a service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Refreshing network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628324.950534, 872fce9b-adf0-4c6f-820e-0d76b59ea36d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:45:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully detached device vdb from instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d from the live domain config.
Aug 10 00:45:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFfUitaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:45:24 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d510d-7aad-454d-b032-24dc25d6e852]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2ed0fd-ce3a-4edb-a9f4-77be12de24ee]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:25 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:25 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 (non-flash)
Aug 10 00:45:25 user nova-compute[73029]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:25 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141be950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c614a6-a992-4614-adea-8ed1acca7f63]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f89ba97-1354-4cf3-a1e3-4045dccd6838]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c80ba91-6015-4965-a65c-708da5483d10]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c8e4fd-76eb-4094-92e7-14852106843c]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dde45e8-d8e7-4ae5-8316-034dc6ad8752]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[27882e02-5e5b-4914-b6be-465689a3e6b7]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260]
Aug 10 00:45:25 user nova-compute[73029]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7, portal: 172.16.0.220,3260] successful.
Aug 10 00:45:25 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1af2a0ff-56b7-44a7-b563-7cd4155d8eb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc70a61f-56a2-4b89-95d4-968a61d1f976]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] <== disconnect_volume: return (393ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-30971286-d791-42f2-98f5-da0e13c15092 req-acfa7a49-2927-4f9e-ba5b-e6e0dde04d4a service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updated VIF entry in instance network info cache for port be6b05f6-41c0-47d0-b2a1-e9a5619ce08b. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-30971286-d791-42f2-98f5-da0e13c15092 req-acfa7a49-2927-4f9e-ba5b-e6e0dde04d4a service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updating instance_info_cache with network_info: [{"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-30971286-d791-42f2-98f5-da0e13c15092 req-acfa7a49-2927-4f9e-ba5b-e6e0dde04d4a service nova] Releasing lock "refresh_cache-872fce9b-adf0-4c6f-820e-0d76b59ea36d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG nova.objects.instance [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'flavor' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-996e22a0-59b2-4b60-93ae-1d9db04d7115 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.143s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:45:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Creating image(s)
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Ensure instance console log exists: /opt/stack/data/nova/instances/87bdf189-555c-4bf1-85cb-b5eed3753dca/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Start _get_guest_xml network_info=[{"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'c2b309d2-3a46-4ff9-8660-a85d0b309520', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRHeCZFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87bdf189-555c-4bf1-85cb-b5eed3753dca', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6cae31c-7aeb-4937-9ac3-38b62c30c710', 'serial': 'e6cae31c-7aeb-4937-9ac3-38b62c30c710'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:45:27 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:45:27 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRHeCZFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:45:27 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:27 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:27 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88ef137-b1a5-4014-b568-163d1077fec4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:45:27 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7c257-cad0-41e3-9abe-a6b2ae4c33d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710] added
Aug 10 00:45:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca0163c-85fc-4aa0-b68c-d44900cdace1]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0414adf8-5c19-49e8-a207-e05ec4369b4a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRHeCZFL {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRHeCZFL" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa05a985-f2f4-4093-bf86-29f29f0a96a0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JRHeCZFL'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c669290-96e4-4540-a452-4923f7a45adc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f1e236-9aec-4714-9ca8-a40d6f776216]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf624df-d267-4527-978e-5b7c0db87b78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260]
Aug 10 00:45:27 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260] successful.
Aug 10 00:45:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8074b48-05fd-416f-819c-cb26613c6db0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bf5754-cce0-4646-8711-cf5c8988b2d6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:27 user nova-compute[73029]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:45:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:27 user nova-compute[73029]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:45:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0643f6d2-0efa-4c0a-b654-27b6e2fe3576]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRHeCZFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628312.9430952, c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:45:27 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] VM Stopped (Lifecycle Event)
Aug 10 00:45:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-bec0888d-8a39-4d2d-8464-d078a486b652 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.compute.manager [None req-bec0888d-8a39-4d2d-8464-d078a486b652 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:28 user nova-compute[73029]: INFO nova.compute.manager [None req-bec0888d-8a39-4d2d-8464-d078a486b652 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Starting finish_migration {{(pid=73029) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance directory exists: not creating {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 10 00:45:28 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Creating image(s)
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'trusted_certs' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk. size=21474836480 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk 21474836480 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk 21474836480" returned: 0 in 0.046s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Ensure instance console log exists: /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Start _get_guest_xml network_info=[{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-817317076-network", "vif_mac": "fa:16:3e:6b:32:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'b7cd8d75-444f-498e-aebd-35267bb29610', 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c4da58fe-aaf3-413d-aa56-48cf53e3a1d5', 'attached_at': '2023-08-10T00:45:28.000000', 'detached_at': '', 'volume_id': 'efab513d-9a6c-4422-8efc-501492f13fa4', 'serial': 'efab513d-9a6c-4422-8efc-501492f13fa4'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:45:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.601s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] <== connect_volume: return (1603ms) {'type': 'block', 'scsi_wwn': '26339313234663862', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:45:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339313234663862', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:45:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:45:29 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:45:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7702MB free_disk=25.27960205078125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3ecd09-6be7-40b2-b858-aa9bdd21c8f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:45:29 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-122230355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-122230355',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn6b0RvSjlr4qzfZjVXoWj2PIrxciTiPOYgKZjzkDkC1B6RxtLw3DaUNafzuQ/VYtXasTgpZXLAj7T1zQ7bM8cO35G0xt5HXDWFvm+zHBR6fzyt5SgxtU/1uYGuUgWVjA==',key_name='tempest-keypair-1957671487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07258fd0d1784a0584f05238888556d7',ramdisk_id='',reservation_id='r-gc00zg80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1416245590',owner_user_name='tempest-ServerActionsV293TestJSON-1416245590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28a10069ba1b486491a647c7aaec3324',uuid=87bdf189-555c-4bf1-85cb-b5eed3753dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converting VIF {"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lazy-loading 'pci_devices' on Instance uuid 87bdf189-555c-4bf1-85cb-b5eed3753dca {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[31388d9e-c371-4632-81b4-fcba6f4471e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4] added
Aug 10 00:45:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:45:29 user nova-compute[73029]:   <uuid>87bdf189-555c-4bf1-85cb-b5eed3753dca</uuid>
Aug 10 00:45:29 user nova-compute[73029]:   <name>instance-00000019</name>
Aug 10 00:45:29 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:45:29 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:45:29 user nova-compute[73029]:   <metadata>
Aug 10 00:45:29 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:45:29 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:45:29 user nova-compute[73029]:       <nova:name>tempest-ServerActionsV293TestJSON-server-122230355</nova:name>
Aug 10 00:45:29 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:45:27</nova:creationTime>
Aug 10 00:45:29 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:45:29 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:45:29 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:45:29 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:45:29 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:45:29 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:45:29 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:45:29 user nova-compute[73029]:       <nova:owner>
Aug 10 00:45:29 user nova-compute[73029]:         <nova:user uuid="28a10069ba1b486491a647c7aaec3324">tempest-ServerActionsV293TestJSON-1416245590-project-member</nova:user>
Aug 10 00:45:29 user nova-compute[73029]:         <nova:project uuid="07258fd0d1784a0584f05238888556d7">tempest-ServerActionsV293TestJSON-1416245590</nova:project>
Aug 10 00:45:29 user nova-compute[73029]:       </nova:owner>
Aug 10 00:45:29 user nova-compute[73029]:       <nova:ports>
Aug 10 00:45:29 user nova-compute[73029]:         <nova:port uuid="969e1ff4-cb79-4f35-9121-d34f9ef7849d">
Aug 10 00:45:29 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 00:45:29 user nova-compute[73029]:         </nova:port>
Aug 10 00:45:29 user nova-compute[73029]:       </nova:ports>
Aug 10 00:45:29 user nova-compute[73029]:     </nova:instance>
Aug 10 00:45:29 user nova-compute[73029]:   </metadata>
Aug 10 00:45:29 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:45:29 user nova-compute[73029]:     <system>
Aug 10 00:45:29 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:45:29 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:45:29 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:45:29 user nova-compute[73029]:       <entry name="serial">87bdf189-555c-4bf1-85cb-b5eed3753dca</entry>
Aug 10 00:45:29 user nova-compute[73029]:       <entry name="uuid">87bdf189-555c-4bf1-85cb-b5eed3753dca</entry>
Aug 10 00:45:29 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:45:29 user nova-compute[73029]:     </system>
Aug 10 00:45:29 user nova-compute[73029]:   </sysinfo>
Aug 10 00:45:29 user nova-compute[73029]:   <os>
Aug 10 00:45:29 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:45:29 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:45:29 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:45:29 user nova-compute[73029]:   </os>
Aug 10 00:45:29 user nova-compute[73029]:   <features>
Aug 10 00:45:29 user nova-compute[73029]:     <acpi/>
Aug 10 00:45:29 user nova-compute[73029]:     <apic/>
Aug 10 00:45:29 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:45:29 user nova-compute[73029]:   </features>
Aug 10 00:45:29 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:45:29 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:45:29 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:45:29 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:45:29 user nova-compute[73029]:   </clock>
Aug 10 00:45:29 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:45:29 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:45:29 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:45:29 user nova-compute[73029]:   </cpu>
Aug 10 00:45:29 user nova-compute[73029]:   <devices>
Aug 10 00:45:29 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:45:29 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:45:29 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 00:45:29 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:45:29 user nova-compute[73029]:       <serial>e6cae31c-7aeb-4937-9ac3-38b62c30c710</serial>
Aug 10 00:45:29 user nova-compute[73029]:     </disk>
Aug 10 00:45:29 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:45:29 user nova-compute[73029]:       <mac address="fa:16:3e:c5:d1:85"/>
Aug 10 00:45:29 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:45:29 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:45:29 user nova-compute[73029]:       <target dev="tap969e1ff4-cb"/>
Aug 10 00:45:29 user nova-compute[73029]:     </interface>
Aug 10 00:45:29 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:45:29 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/87bdf189-555c-4bf1-85cb-b5eed3753dca/console.log" append="off"/>
Aug 10 00:45:29 user nova-compute[73029]:     </serial>
Aug 10 00:45:29 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:45:29 user nova-compute[73029]:     <video>
Aug 10 00:45:29 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:45:29 user nova-compute[73029]:     </video>
Aug 10 00:45:29 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:45:29 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:45:29 user nova-compute[73029]:     </rng>
Aug 10 00:45:29 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:45:29 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:45:29 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:45:29 user nova-compute[73029]:     </memballoon>
Aug 10 00:45:29 user nova-compute[73029]:   </devices>
Aug 10 00:45:29 user nova-compute[73029]: </domain>
Aug 10 00:45:29 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-122230355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-122230355',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn6b0RvSjlr4qzfZjVXoWj2PIrxciTiPOYgKZjzkDkC1B6RxtLw3DaUNafzuQ/VYtXasTgpZXLAj7T1zQ7bM8cO35G0xt5HXDWFvm+zHBR6fzyt5SgxtU/1uYGuUgWVjA==',key_name='tempest-keypair-1957671487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07258fd0d1784a0584f05238888556d7',ramdisk_id='',reservation_id='r-gc00zg80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1416245590',owner_user_name='tempest-ServerActionsV293TestJSON-1416245590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28a10069ba1b486491a647c7aaec3324',uuid=87bdf189-555c-4bf1-85cb-b5eed3753dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converting VIF {"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_vif [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap969e1ff4-cb, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap969e1ff4-cb, col_values=(('external_ids', {'iface-id': '969e1ff4-cb79-4f35-9121-d34f9ef7849d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:d1:85', 'vm-uuid': '87bdf189-555c-4bf1-85cb-b5eed3753dca'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad8c6b7-e749-411c-b30d-77b0d44aa296]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f656ad7b-7329-4f78-bbe7-29db2ef1fbcf]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:29 user nova-compute[73029]: INFO os_vif [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb')
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjLUxpTM {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Applying migration context for instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 as it has an incoming, in-progress migration e13e83d3-6c8b-4c71-afb0-f0af16f06f45. Migration status is post-migrating {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 10 00:45:29 user nova-compute[73029]: INFO nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating resource usage from migration e13e83d3-6c8b-4c71-afb0-f0af16f06f45
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjLUxpTM" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[06416188-627f-4d22-bb18-685637ec634c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjLUxpTM'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[00562476-49d1-4933-92e5-c95391e23c86]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 889d1049-c384-4ad3-837c-4c739f345e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a759a046-b39b-4c7d-88ce-bf6922af5a81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Migration e13e83d3-6c8b-4c71-afb0-f0af16f06f45 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 655f9889-40ea-416f-9df2-71838819c37b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 87bdf189-555c-4bf1-85cb-b5eed3753dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] No VIF found with MAC fa:16:3e:c5:d1:85, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[87df679c-eba1-4e17-a101-d80adc517ba7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:29 user nova-compute[73029]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:45:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:29 user nova-compute[73029]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:45:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:45:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --login" returned: 0 in 1.061s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9320e6d-a2da-492b-8e4f-04fa4828506b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]
Aug 10 00:45:30 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.
Aug 10 00:45:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abe93f4-b6c7-472c-a5c5-3c20c78de353]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d989a8a4-c507-44c4-a33b-184fc2cd5121]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:30 user nova-compute[73029]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:45:30 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:45:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:45:30 user nova-compute[73029]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:45:30 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:45:30 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.304s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[915ac41b-7a9e-4b50-8c91-eca2975bd3cb]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-4fa72dd1-444a-4996-a4f3-bdb4b9e6d90e req-29035e1b-ffb2-4f45-b8c8-b9601aee97d9 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4fa72dd1-444a-4996-a4f3-bdb4b9e6d90e req-29035e1b-ffb2-4f45-b8c8-b9601aee97d9 service nova] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4fa72dd1-444a-4996-a4f3-bdb4b9e6d90e req-29035e1b-ffb2-4f45-b8c8-b9601aee97d9 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4fa72dd1-444a-4996-a4f3-bdb4b9e6d90e req-29035e1b-ffb2-4f45-b8c8-b9601aee97d9 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-4fa72dd1-444a-4996-a4f3-bdb4b9e6d90e req-29035e1b-ffb2-4f45-b8c8-b9601aee97d9 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] No waiting events found dispatching network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:45:30 user nova-compute[73029]: WARNING nova.compute.manager [req-4fa72dd1-444a-4996-a4f3-bdb4b9e6d90e req-29035e1b-ffb2-4f45-b8c8-b9601aee97d9 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received unexpected event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d for instance with vm_state building and task_state spawning.
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.334s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] <== connect_volume: return (2335ms) {'type': 'block', 'scsi_wwn': '23639313237316231', 'path': '/dev/sdd'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639313237316231', 'path': '/dev/sdd'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-269092502',display_name='tempest-ServerActionsTestOtherB-server-269092502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-269092502',id=19,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItzikrNamyVCnXNCeYWOUlFND2bQ8Tuk4qPbQ4GANcUlImEfJj3KUpqnSakA5oCLo1HOK7tJ0c86mCVYnqC3w/Zcx+l5l4Z97MDUOsNoNFHs+ZvBbIlKUjuqYy9iRb8Lw==',key_name='tempest-keypair-1753578335',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74ad7b2647e5407b89ce46595c1fc9e8',ramdisk_id='',reservation_id='r-e1uzv60r',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539813810',owner_user_name='tempest-ServerActionsTestOtherB-539813810-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1bb9034314565893a8d3629f8cd0c',uuid=c4da58fe-aaf3-413d-aa56-48cf53e3a1d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-817317076-network", "vif_mac": "fa:16:3e:6b:32:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converting VIF {"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-817317076-network", "vif_mac": "fa:16:3e:6b:32:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:45:31 user nova-compute[73029]:   <uuid>c4da58fe-aaf3-413d-aa56-48cf53e3a1d5</uuid>
Aug 10 00:45:31 user nova-compute[73029]:   <name>instance-00000013</name>
Aug 10 00:45:31 user nova-compute[73029]:   <memory>2097152</memory>
Aug 10 00:45:31 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:45:31 user nova-compute[73029]:   <metadata>
Aug 10 00:45:31 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:45:31 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:45:31 user nova-compute[73029]:       <nova:name>tempest-ServerActionsTestOtherB-server-269092502</nova:name>
Aug 10 00:45:31 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:45:28</nova:creationTime>
Aug 10 00:45:31 user nova-compute[73029]:       <nova:flavor name="m1.small">
Aug 10 00:45:31 user nova-compute[73029]:         <nova:memory>2048</nova:memory>
Aug 10 00:45:31 user nova-compute[73029]:         <nova:disk>20</nova:disk>
Aug 10 00:45:31 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:45:31 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:45:31 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:45:31 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:45:31 user nova-compute[73029]:       <nova:owner>
Aug 10 00:45:31 user nova-compute[73029]:         <nova:user uuid="f3e1bb9034314565893a8d3629f8cd0c">tempest-ServerActionsTestOtherB-539813810-project-member</nova:user>
Aug 10 00:45:31 user nova-compute[73029]:         <nova:project uuid="74ad7b2647e5407b89ce46595c1fc9e8">tempest-ServerActionsTestOtherB-539813810</nova:project>
Aug 10 00:45:31 user nova-compute[73029]:       </nova:owner>
Aug 10 00:45:31 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:45:31 user nova-compute[73029]:       <nova:ports>
Aug 10 00:45:31 user nova-compute[73029]:         <nova:port uuid="7e775285-84c8-4049-9914-d6b201090b0a">
Aug 10 00:45:31 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 00:45:31 user nova-compute[73029]:         </nova:port>
Aug 10 00:45:31 user nova-compute[73029]:       </nova:ports>
Aug 10 00:45:31 user nova-compute[73029]:     </nova:instance>
Aug 10 00:45:31 user nova-compute[73029]:   </metadata>
Aug 10 00:45:31 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:45:31 user nova-compute[73029]:     <system>
Aug 10 00:45:31 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:45:31 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:45:31 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:45:31 user nova-compute[73029]:       <entry name="serial">c4da58fe-aaf3-413d-aa56-48cf53e3a1d5</entry>
Aug 10 00:45:31 user nova-compute[73029]:       <entry name="uuid">c4da58fe-aaf3-413d-aa56-48cf53e3a1d5</entry>
Aug 10 00:45:31 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:45:31 user nova-compute[73029]:     </system>
Aug 10 00:45:31 user nova-compute[73029]:   </sysinfo>
Aug 10 00:45:31 user nova-compute[73029]:   <os>
Aug 10 00:45:31 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:45:31 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:45:31 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:45:31 user nova-compute[73029]:   </os>
Aug 10 00:45:31 user nova-compute[73029]:   <features>
Aug 10 00:45:31 user nova-compute[73029]:     <acpi/>
Aug 10 00:45:31 user nova-compute[73029]:     <apic/>
Aug 10 00:45:31 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:45:31 user nova-compute[73029]:   </features>
Aug 10 00:45:31 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:45:31 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:45:31 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:45:31 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:45:31 user nova-compute[73029]:   </clock>
Aug 10 00:45:31 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:45:31 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:45:31 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:45:31 user nova-compute[73029]:   </cpu>
Aug 10 00:45:31 user nova-compute[73029]:   <devices>
Aug 10 00:45:31 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:45:31 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:45:31 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk"/>
Aug 10 00:45:31 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:45:31 user nova-compute[73029]:     </disk>
Aug 10 00:45:31 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:45:31 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:45:31 user nova-compute[73029]:       <source dev="/dev/sdd"/>
Aug 10 00:45:31 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:45:31 user nova-compute[73029]:       <serial>efab513d-9a6c-4422-8efc-501492f13fa4</serial>
Aug 10 00:45:31 user nova-compute[73029]:     </disk>
Aug 10 00:45:31 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:45:31 user nova-compute[73029]:       <mac address="fa:16:3e:6b:32:5a"/>
Aug 10 00:45:31 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:45:31 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:45:31 user nova-compute[73029]:       <target dev="tap7e775285-84"/>
Aug 10 00:45:31 user nova-compute[73029]:     </interface>
Aug 10 00:45:31 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:45:31 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/console.log" append="off"/>
Aug 10 00:45:31 user nova-compute[73029]:     </serial>
Aug 10 00:45:31 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:45:31 user nova-compute[73029]:     <video>
Aug 10 00:45:31 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:45:31 user nova-compute[73029]:     </video>
Aug 10 00:45:31 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:45:31 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:45:31 user nova-compute[73029]:     </rng>
Aug 10 00:45:31 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:45:31 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:45:31 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:45:31 user nova-compute[73029]:     </memballoon>
Aug 10 00:45:31 user nova-compute[73029]:   </devices>
Aug 10 00:45:31 user nova-compute[73029]: </domain>
Aug 10 00:45:31 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-269092502',display_name='tempest-ServerActionsTestOtherB-server-269092502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-269092502',id=19,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItzikrNamyVCnXNCeYWOUlFND2bQ8Tuk4qPbQ4GANcUlImEfJj3KUpqnSakA5oCLo1HOK7tJ0c86mCVYnqC3w/Zcx+l5l4Z97MDUOsNoNFHs+ZvBbIlKUjuqYy9iRb8Lw==',key_name='tempest-keypair-1753578335',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74ad7b2647e5407b89ce46595c1fc9e8',ramdisk_id='',reservation_id='r-e1uzv60r',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539813810',owner_user_name='tempest-ServerActionsTestOtherB-539813810-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1bb9034314565893a8d3629f8cd0c',uuid=c4da58fe-aaf3-413d-aa56-48cf53e3a1d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-817317076-network", "vif_mac": "fa:16:3e:6b:32:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converting VIF {"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-817317076-network", "vif_mac": "fa:16:3e:6b:32:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG os_vif [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e775285-84, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e775285-84, col_values=(('external_ids', {'iface-id': '7e775285-84c8-4049-9914-d6b201090b0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:32:5a', 'vm-uuid': 'c4da58fe-aaf3-413d-aa56-48cf53e3a1d5'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:31 user nova-compute[73029]: INFO os_vif [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84')
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:45:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] No VIF found with MAC fa:16:3e:6b:32:5a, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:45:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-c3a0583f-166c-499e-b7e6-885b0460df40 req-14dac219-eb4e-47cd-8dfe-02d7f0a3b1bb service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c3a0583f-166c-499e-b7e6-885b0460df40 req-14dac219-eb4e-47cd-8dfe-02d7f0a3b1bb service nova] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c3a0583f-166c-499e-b7e6-885b0460df40 req-14dac219-eb4e-47cd-8dfe-02d7f0a3b1bb service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c3a0583f-166c-499e-b7e6-885b0460df40 req-14dac219-eb4e-47cd-8dfe-02d7f0a3b1bb service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-c3a0583f-166c-499e-b7e6-885b0460df40 req-14dac219-eb4e-47cd-8dfe-02d7f0a3b1bb service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] No waiting events found dispatching network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:45:32 user nova-compute[73029]: WARNING nova.compute.manager [req-c3a0583f-166c-499e-b7e6-885b0460df40 req-14dac219-eb4e-47cd-8dfe-02d7f0a3b1bb service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received unexpected event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d for instance with vm_state building and task_state spawning.
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628333.011285, 87bdf189-555c-4bf1-85cb-b5eed3753dca => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:45:33 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] VM Resumed (Lifecycle Event)
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:45:33 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance spawned successfully.
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:45:33 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628333.012191, 87bdf189-555c-4bf1-85cb-b5eed3753dca => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:45:33 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] VM Started (Lifecycle Event)
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-7fae2980-45e9-47ea-872f-28f82d649dcf req-50afe000-ae47-4990-ac5d-42c15f3f5dd5 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7fae2980-45e9-47ea-872f-28f82d649dcf req-50afe000-ae47-4990-ac5d-42c15f3f5dd5 service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7fae2980-45e9-47ea-872f-28f82d649dcf req-50afe000-ae47-4990-ac5d-42c15f3f5dd5 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7fae2980-45e9-47ea-872f-28f82d649dcf req-50afe000-ae47-4990-ac5d-42c15f3f5dd5 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-7fae2980-45e9-47ea-872f-28f82d649dcf req-50afe000-ae47-4990-ac5d-42c15f3f5dd5 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:45:33 user nova-compute[73029]: WARNING nova.compute.manager [req-7fae2980-45e9-47ea-872f-28f82d649dcf req-50afe000-ae47-4990-ac5d-42c15f3f5dd5 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state active and task_state resize_finish.
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:45:33 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:45:33 user nova-compute[73029]: INFO nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 10 00:45:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:45:33 user nova-compute[73029]: INFO nova.compute.manager [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Took 17.95 seconds to build instance.
Aug 10 00:45:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4552e6b2-9dc0-4fc3-ab78-cb1983d0ae6b tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.113s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-68b47bba-d4a6-4df3-bffd-99c72e8c5bab req-3335f304-2477-4a25-bee5-65dcb0834b00 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-68b47bba-d4a6-4df3-bffd-99c72e8c5bab req-3335f304-2477-4a25-bee5-65dcb0834b00 service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-68b47bba-d4a6-4df3-bffd-99c72e8c5bab req-3335f304-2477-4a25-bee5-65dcb0834b00 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-68b47bba-d4a6-4df3-bffd-99c72e8c5bab req-3335f304-2477-4a25-bee5-65dcb0834b00 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-68b47bba-d4a6-4df3-bffd-99c72e8c5bab req-3335f304-2477-4a25-bee5-65dcb0834b00 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:45:35 user nova-compute[73029]: WARNING nova.compute.manager [req-68b47bba-d4a6-4df3-bffd-99c72e8c5bab req-3335f304-2477-4a25-bee5-65dcb0834b00 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state active and task_state resize_finish.
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628335.334583, c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:45:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] VM Resumed (Lifecycle Event)
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:45:35 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance running successfully.
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Failed to set time: agent not configured {{(pid=73029) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2e4a815a-1d7a-4329-8391-11ad9f2e4fa1 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] finish_migration finished successfully. {{(pid=73029) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:45:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628335.3360286, c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:45:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] VM Started (Lifecycle Event)
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:45:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:45:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 10 00:45:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:58 user nova-compute[73029]: INFO nova.compute.manager [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Terminating instance
Aug 10 00:45:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-864546c6-c7ac-4908-aa3d-a5605c23d7ba req-a61da84a-87f7-439d-ae94-08fcfaccf52b service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received event network-vif-unplugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-864546c6-c7ac-4908-aa3d-a5605c23d7ba req-a61da84a-87f7-439d-ae94-08fcfaccf52b service nova] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-864546c6-c7ac-4908-aa3d-a5605c23d7ba req-a61da84a-87f7-439d-ae94-08fcfaccf52b service nova] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-864546c6-c7ac-4908-aa3d-a5605c23d7ba req-a61da84a-87f7-439d-ae94-08fcfaccf52b service nova] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-864546c6-c7ac-4908-aa3d-a5605c23d7ba req-a61da84a-87f7-439d-ae94-08fcfaccf52b service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] No waiting events found dispatching network-vif-unplugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-864546c6-c7ac-4908-aa3d-a5605c23d7ba req-a61da84a-87f7-439d-ae94-08fcfaccf52b service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received event network-vif-unplugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Instance destroyed successfully.
Aug 10 00:45:59 user nova-compute[73029]: DEBUG nova.objects.instance [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'resources' on Instance uuid 889d1049-c384-4ad3-837c-4c739f345e1c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-351120651',display_name='tempest-AttachVolumeNegativeTest-server-351120651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-351120651',id=22,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX39A1rScYkmK88fixCMJm1+ctq1nv/6LW9e+3n7GZWkpRDIt93Zl2UFkQVtH7mtGe1hCmLiGn3Ndqe0cjddxgV04q4ArddRXErtpjUnRtRwz8dTpuQqHqij0HmIFQiCA==',key_name='tempest-keypair-1598194538',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-n2i05e0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=889d1049-c384-4ad3-837c-4c739f345e1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "address": "fa:16:3e:22:31:02", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebba57ea-ef", "ovs_interfaceid": "ebba57ea-ef60-4d81-84a0-91ed11028df9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:31:02,bridge_name='br-int',has_traffic_filtering=True,id=ebba57ea-ef60-4d81-84a0-91ed11028df9,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebba57ea-ef') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG os_vif [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:31:02,bridge_name='br-int',has_traffic_filtering=True,id=ebba57ea-ef60-4d81-84a0-91ed11028df9,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebba57ea-ef') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebba57ea-ef, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:45:59 user nova-compute[73029]: INFO os_vif [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:31:02,bridge_name='br-int',has_traffic_filtering=True,id=ebba57ea-ef60-4d81-84a0-91ed11028df9,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebba57ea-ef')
Aug 10 00:45:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Deleting instance files /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c_del
Aug 10 00:45:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Deletion of /opt/stack/data/nova/instances/889d1049-c384-4ad3-837c-4c739f345e1c_del complete
Aug 10 00:45:59 user nova-compute[73029]: INFO nova.compute.manager [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 10 00:45:59 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:45:59 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:45:59 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Took 0.85 seconds to deallocate network for instance.
Aug 10 00:46:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:00 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:46:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:46:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:00 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Deleted allocations for instance 889d1049-c384-4ad3-837c-4c739f345e1c
Aug 10 00:46:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-89335155-1c98-4e84-bb99-c05f4f0237ea tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "889d1049-c384-4ad3-837c-4c739f345e1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-beeacfc2-6048-4bb1-a48b-4fbf198183cb req-15398757-bd8f-4ff7-bcf2-d6f3fefc65ff service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received event network-vif-plugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-beeacfc2-6048-4bb1-a48b-4fbf198183cb req-15398757-bd8f-4ff7-bcf2-d6f3fefc65ff service nova] Acquiring lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-beeacfc2-6048-4bb1-a48b-4fbf198183cb req-15398757-bd8f-4ff7-bcf2-d6f3fefc65ff service nova] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-beeacfc2-6048-4bb1-a48b-4fbf198183cb req-15398757-bd8f-4ff7-bcf2-d6f3fefc65ff service nova] Lock "889d1049-c384-4ad3-837c-4c739f345e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-beeacfc2-6048-4bb1-a48b-4fbf198183cb req-15398757-bd8f-4ff7-bcf2-d6f3fefc65ff service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] No waiting events found dispatching network-vif-plugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:00 user nova-compute[73029]: WARNING nova.compute.manager [req-beeacfc2-6048-4bb1-a48b-4fbf198183cb req-15398757-bd8f-4ff7-bcf2-d6f3fefc65ff service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received unexpected event network-vif-plugged-ebba57ea-ef60-4d81-84a0-91ed11028df9 for instance with vm_state deleted and task_state None.
Aug 10 00:46:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-beeacfc2-6048-4bb1-a48b-4fbf198183cb req-15398757-bd8f-4ff7-bcf2-d6f3fefc65ff service nova] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Received event network-vif-deleted-ebba57ea-ef60-4d81-84a0-91ed11028df9 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 00:46:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628359.0303948, 889d1049-c384-4ad3-837c-4c739f345e1c => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:46:14 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] VM Stopped (Lifecycle Event)
Aug 10 00:46:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8b1fa6f1-a3d3-47df-aea1-86c0e3008625 None None] [instance: 889d1049-c384-4ad3-837c-4c739f345e1c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-92420022-a48f-4306-920b-eea0a3513737 req-1ce775a4-c6cb-454c-a273-1d803d09988e service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-changed-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-92420022-a48f-4306-920b-eea0a3513737 req-1ce775a4-c6cb-454c-a273-1d803d09988e service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Refreshing instance network info cache due to event network-changed-756092b1-bc75-4163-a66c-ecaff9bcb39d. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-92420022-a48f-4306-920b-eea0a3513737 req-1ce775a4-c6cb-454c-a273-1d803d09988e service nova] Acquiring lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-92420022-a48f-4306-920b-eea0a3513737 req-1ce775a4-c6cb-454c-a273-1d803d09988e service nova] Acquired lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG nova.network.neutron [req-92420022-a48f-4306-920b-eea0a3513737 req-1ce775a4-c6cb-454c-a273-1d803d09988e service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Refreshing network info cache for port 756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG nova.network.neutron [req-92420022-a48f-4306-920b-eea0a3513737 req-1ce775a4-c6cb-454c-a273-1d803d09988e service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updated VIF entry in instance network info cache for port 756092b1-bc75-4163-a66c-ecaff9bcb39d. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG nova.network.neutron [req-92420022-a48f-4306-920b-eea0a3513737 req-1ce775a4-c6cb-454c-a273-1d803d09988e service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating instance_info_cache with network_info: [{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:46:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-92420022-a48f-4306-920b-eea0a3513737 req-1ce775a4-c6cb-454c-a273-1d803d09988e service nova] Releasing lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:46:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Stashing vm_state: active {{(pid=73029) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 10 00:46:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:15 user nova-compute[73029]: DEBUG nova.objects.instance [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'pci_requests' on Instance uuid a759a046-b39b-4c7d-88ce-bf6922af5a81 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:46:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:46:15 user nova-compute[73029]: INFO nova.compute.claims [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Claim successful on node user
Aug 10 00:46:15 user nova-compute[73029]: DEBUG nova.objects.instance [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'resources' on Instance uuid a759a046-b39b-4c7d-88ce-bf6922af5a81 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:46:15 user nova-compute[73029]: DEBUG nova.objects.instance [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'pci_devices' on Instance uuid a759a046-b39b-4c7d-88ce-bf6922af5a81 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:46:15 user nova-compute[73029]: INFO nova.compute.resource_tracker [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating resource usage from migration 61f90acd-6088-4084-ac72-a1f8c83d78c1
Aug 10 00:46:15 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:46:15 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.443s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:16 user nova-compute[73029]: INFO nova.compute.manager [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Migrating
Aug 10 00:46:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquired lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-cc75f1ec-b278-4abd-b843-91b8fe073d8f req-c23d8068-d9a6-4805-83be-90444d4582e4 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-changed-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-cc75f1ec-b278-4abd-b843-91b8fe073d8f req-c23d8068-d9a6-4805-83be-90444d4582e4 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Refreshing instance network info cache due to event network-changed-24e98d91-db37-4730-97d2-f9fb3cf8c9a0. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc75f1ec-b278-4abd-b843-91b8fe073d8f req-c23d8068-d9a6-4805-83be-90444d4582e4 service nova] Acquiring lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating instance_info_cache with network_info: [{"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Releasing lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc75f1ec-b278-4abd-b843-91b8fe073d8f req-c23d8068-d9a6-4805-83be-90444d4582e4 service nova] Acquired lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG nova.network.neutron [req-cc75f1ec-b278-4abd-b843-91b8fe073d8f req-c23d8068-d9a6-4805-83be-90444d4582e4 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Refreshing network info cache for port 24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Starting migrate_disk_and_power_off {{(pid=73029) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.network.neutron [req-cc75f1ec-b278-4abd-b843-91b8fe073d8f req-c23d8068-d9a6-4805-83be-90444d4582e4 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updated VIF entry in instance network info cache for port 24e98d91-db37-4730-97d2-f9fb3cf8c9a0. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.network.neutron [req-cc75f1ec-b278-4abd-b843-91b8fe073d8f req-c23d8068-d9a6-4805-83be-90444d4582e4 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating instance_info_cache with network_info: [{"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc75f1ec-b278-4abd-b843-91b8fe073d8f req-c23d8068-d9a6-4805-83be-90444d4582e4 service nova] Releasing lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:46:17 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Instance destroyed successfully.
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-774975152',display_name='tempest-ServerActionsTestOtherA-server-774975152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-774975152',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-6uqo1cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=a759a046-b39b-4c7d-88ce-bf6922af5a81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-310216871-network", "vif_mac": "fa:16:3e:cf:99:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-310216871-network", "vif_mac": "fa:16:3e:cf:99:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_vif [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24e98d91-db, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:46:17 user nova-compute[73029]: INFO os_vif [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db')
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyHhNILq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:46:17 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc8bc78-e77c-4c40-ab2e-533e8781a8c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[22af183e-ab1e-4d52-93dd-f597a188f835]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:46:17 user nova-compute[73029]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:46:17 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:46:17 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:46:17 user nova-compute[73029]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:46:17 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:46:17 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f0713490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d7126a-d9eb-4cb6-973d-75bdf6ce3a46]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1dd81d-731d-4164-96cb-618b3c8b77dd]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eb3764-819f-40b6-8c4d-f7153939d3c3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5ad6f1-0b3b-4175-ab81-73cbd558cbbb]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance_info_cache with network_info: [{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23433346337646566', '/dev/disk/by-id/scsi-1SCST_BIO37921771-434c7defc9e7c6c1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_37921771') {{(pid=84041) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f768c50-f1c5-4623-a261-6db2c990a78e]: (4, None) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830057d-a3ad-44e4-a7d2-52007ea859f8]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80059f2-026d-4211-905a-8483db01af70]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260]
Aug 10 00:46:17 user nova-compute[73029]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260] successful.
Aug 10 00:46:17 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cb9ba4-25c2-4e74-9d6a-9f229b548761]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== disconnect_volume: return (295ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:46:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-unplugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] No waiting events found dispatching network-vif-unplugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:18 user nova-compute[73029]: WARNING nova.compute.manager [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received unexpected event network-vif-unplugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 for instance with vm_state active and task_state resize_migrating.
Aug 10 00:46:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] No waiting events found dispatching network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:18 user nova-compute[73029]: WARNING nova.compute.manager [req-2191d15e-ca3d-44fe-b3a9-edf240640939 req-f838a511-a9a0-4fca-a9b1-0fdb55f9d93e service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received unexpected event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 for instance with vm_state active and task_state resize_migrating.
Aug 10 00:46:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Port 24e98d91-db37-4730-97d2-f9fb3cf8c9a0 binding to destination host user is already ACTIVE {{(pid=73029) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquired lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating instance_info_cache with network_info: [{"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Releasing lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG os_brick.utils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcc36cb-1f43-4fba-8a47-fce5e227ef09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca137d15-06dd-41c9-baa8-cce8c7dc60f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[be861cbb-64cf-4a1e-be27-7ab3a4ec64fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c69af-395c-45e8-b7e3-1399b744c70a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:46:19 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:46:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[499456f8-9a92-4009-9d56-727035068187]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:46:19 user nova-compute[73029]: DEBUG os_brick.utils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:46:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:23 user nova-compute[73029]: INFO nova.compute.manager [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Terminating instance
Aug 10 00:46:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-9aeb9546-2afd-4431-8952-6ba4e96d2b72 req-630fd17e-7f36-4ea7-b8be-29e581f902e4 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-unplugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9aeb9546-2afd-4431-8952-6ba4e96d2b72 req-630fd17e-7f36-4ea7-b8be-29e581f902e4 service nova] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9aeb9546-2afd-4431-8952-6ba4e96d2b72 req-630fd17e-7f36-4ea7-b8be-29e581f902e4 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9aeb9546-2afd-4431-8952-6ba4e96d2b72 req-630fd17e-7f36-4ea7-b8be-29e581f902e4 service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-9aeb9546-2afd-4431-8952-6ba4e96d2b72 req-630fd17e-7f36-4ea7-b8be-29e581f902e4 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] No waiting events found dispatching network-vif-unplugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-9aeb9546-2afd-4431-8952-6ba4e96d2b72 req-630fd17e-7f36-4ea7-b8be-29e581f902e4 service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-unplugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:46:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Instance destroyed successfully.
Aug 10 00:46:24 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'resources' on Instance uuid 872fce9b-adf0-4c6f-820e-0d76b59ea36d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724206694',display_name='tempest-TestMinimumBasicScenario-server-724206694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724206694',id=21,image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyvuwaNsaWL2ieB5B79GJsBSEJ1Puvg7jYv05H2n+tMu8V79v3UFwmPyW2Gxwu3XdgLMPSnIB+Cj/GsdfVHMUSkaSjDi1U1zPbizPUbOfg7Bwx1n4YcjkMP0EKGUBAW1A==',key_name='tempest-TestMinimumBasicScenario-943275705',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:41:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bdf72afe44346ebae59db7a6d57a787',ramdisk_id='',reservation_id='r-cu10n5db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a16bbdbd-1f9c-4f09-a0bd-e377815e3823',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-379185014',owner_user_name='tempest-TestMinimumBasicScenario-379185014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:43:41Z,user_data=None,user_id='e4fd570e277240d1b7c1b910a9289aad',uuid=872fce9b-adf0-4c6f-820e-0d76b59ea36d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converting VIF {"id": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "address": "fa:16:3e:b5:50:03", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6b05f6-41", "ovs_interfaceid": "be6b05f6-41c0-47d0-b2a1-e9a5619ce08b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG os_vif [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe6b05f6-41, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:46:24 user nova-compute[73029]: INFO os_vif [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:50:03,bridge_name='br-int',has_traffic_filtering=True,id=be6b05f6-41c0-47d0-b2a1-e9a5619ce08b,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6b05f6-41')
Aug 10 00:46:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Deleting instance files /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d_del
Aug 10 00:46:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Deletion of /opt/stack/data/nova/instances/872fce9b-adf0-4c6f-820e-0d76b59ea36d_del complete
Aug 10 00:46:24 user nova-compute[73029]: INFO nova.compute.manager [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 10 00:46:24 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:46:24 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:46:25 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Took 0.62 seconds to deallocate network for instance.
Aug 10 00:46:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-74ccaf35-acd0-4dcf-a4f0-8f7fce87473a req-85a1e3eb-e537-4afd-97fe-54c55d46a37f service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-74ccaf35-acd0-4dcf-a4f0-8f7fce87473a req-85a1e3eb-e537-4afd-97fe-54c55d46a37f service nova] Acquiring lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-74ccaf35-acd0-4dcf-a4f0-8f7fce87473a req-85a1e3eb-e537-4afd-97fe-54c55d46a37f service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-74ccaf35-acd0-4dcf-a4f0-8f7fce87473a req-85a1e3eb-e537-4afd-97fe-54c55d46a37f service nova] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-74ccaf35-acd0-4dcf-a4f0-8f7fce87473a req-85a1e3eb-e537-4afd-97fe-54c55d46a37f service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] No waiting events found dispatching network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:25 user nova-compute[73029]: WARNING nova.compute.manager [req-74ccaf35-acd0-4dcf-a4f0-8f7fce87473a req-85a1e3eb-e537-4afd-97fe-54c55d46a37f service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received unexpected event network-vif-plugged-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b for instance with vm_state deleted and task_state None.
Aug 10 00:46:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-74ccaf35-acd0-4dcf-a4f0-8f7fce87473a req-85a1e3eb-e537-4afd-97fe-54c55d46a37f service nova] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Received event network-vif-deleted-be6b05f6-41c0-47d0-b2a1-e9a5619ce08b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:25 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Deleted allocations for instance 872fce9b-adf0-4c6f-820e-0d76b59ea36d
Aug 10 00:46:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f9b74f51-12eb-484f-a2f1-abdcbee04813 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "872fce9b-adf0-4c6f-820e-0d76b59ea36d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:46:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:46:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7662MB free_disk=25.302112579345703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Starting finish_migration {{(pid=73029) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Instance directory exists: not creating {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 10 00:46:28 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Creating image(s)
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Ensure instance console log exists: /opt/stack/data/nova/instances/a759a046-b39b-4c7d-88ce-bf6922af5a81/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Start _get_guest_xml network_info=[{"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-310216871-network", "vif_mac": "fa:16:3e:cf:99:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'a853dc9a-0711-4b71-b244-c0e4baabdbb9', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyHhNILq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a759a046-b39b-4c7d-88ce-bf6922af5a81', 'attached_at': '2023-08-10T00:46:29.000000', 'detached_at': '', 'volume_id': 'bb934ac5-976b-4e1f-8572-2a365db9d227', 'serial': 'bb934ac5-976b-4e1f-8572-2a365db9d227'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Applying migration context for instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 as it has an incoming, in-progress migration e13e83d3-6c8b-4c71-afb0-f0af16f06f45. Migration status is finished {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Applying migration context for instance a759a046-b39b-4c7d-88ce-bf6922af5a81 as it has an incoming, in-progress migration 61f90acd-6088-4084-ac72-a1f8c83d78c1. Migration status is post-migrating {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 10 00:46:28 user nova-compute[73029]: INFO nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating resource usage from migration e13e83d3-6c8b-4c71-afb0-f0af16f06f45
Aug 10 00:46:28 user nova-compute[73029]: INFO nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating resource usage from migration 61f90acd-6088-4084-ac72-a1f8c83d78c1
Aug 10 00:46:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:46:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.objects.instance [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'vcpu_model' on Instance uuid a759a046-b39b-4c7d-88ce-bf6922af5a81 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Migration e13e83d3-6c8b-4c71-afb0-f0af16f06f45 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 655f9889-40ea-416f-9df2-71838819c37b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 87bdf189-555c-4bf1-85cb-b5eed3753dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Migration 61f90acd-6088-4084-ac72-a1f8c83d78c1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a759a046-b39b-4c7d-88ce-bf6922af5a81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyHhNILq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:46:28 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:46:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:46:28 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:46:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:46:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:46:28 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd0974-d472-4e25-9edd-e4c941631168]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:46:29 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea000ea0-e14f-4d2b-8d0e-059a7641200a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227] added
Aug 10 00:46:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9919f3-289b-4f12-9048-1f2c31a98071]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcf1c91-3ddb-4283-9317-6110e41bbef0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyHhNILq {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyHhNILq" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ac057-ad90-4525-9573-689ac4936e10]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tyHhNILq'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba5cdc-fc30-4f13-bb7a-c72ffd42b799]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f01e2-078c-47af-b3e8-42714268c320]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8ccb02-c966-4042-bd1b-0f1d304f528d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260]
Aug 10 00:46:29 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260] successful.
Aug 10 00:46:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[df633e2d-2a19-46a7-9bb9-a377977e9d90]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd7ba0b-d63f-44bf-8faf-975007e84851]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:46:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fcd0ce-5366-4ab4-b549-6e7dd4464ed9]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:46:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyHhNILq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23433346337646566', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433346337646566', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-774975152',display_name='tempest-ServerActionsTestOtherA-server-774975152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-774975152',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-6uqo1cb0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=a759a046-b39b-4c7d-88ce-bf6922af5a81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-310216871-network", "vif_mac": "fa:16:3e:cf:99:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-310216871-network", "vif_mac": "fa:16:3e:cf:99:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:46:30 user nova-compute[73029]:   <uuid>a759a046-b39b-4c7d-88ce-bf6922af5a81</uuid>
Aug 10 00:46:30 user nova-compute[73029]:   <name>instance-00000017</name>
Aug 10 00:46:30 user nova-compute[73029]:   <memory>2097152</memory>
Aug 10 00:46:30 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:46:30 user nova-compute[73029]:   <metadata>
Aug 10 00:46:30 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:46:30 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:46:30 user nova-compute[73029]:       <nova:name>tempest-ServerActionsTestOtherA-server-774975152</nova:name>
Aug 10 00:46:30 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:46:28</nova:creationTime>
Aug 10 00:46:30 user nova-compute[73029]:       <nova:flavor name="m1.small">
Aug 10 00:46:30 user nova-compute[73029]:         <nova:memory>2048</nova:memory>
Aug 10 00:46:30 user nova-compute[73029]:         <nova:disk>20</nova:disk>
Aug 10 00:46:30 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:46:30 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:46:30 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:46:30 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:46:30 user nova-compute[73029]:       <nova:owner>
Aug 10 00:46:30 user nova-compute[73029]:         <nova:user uuid="066b8c956dd146209ae7ecabfbf083ff">tempest-ServerActionsTestOtherA-916478349-project-member</nova:user>
Aug 10 00:46:30 user nova-compute[73029]:         <nova:project uuid="60aabdbd31b647d68db993c0a60a43ec">tempest-ServerActionsTestOtherA-916478349</nova:project>
Aug 10 00:46:30 user nova-compute[73029]:       </nova:owner>
Aug 10 00:46:30 user nova-compute[73029]:       <nova:ports>
Aug 10 00:46:30 user nova-compute[73029]:         <nova:port uuid="24e98d91-db37-4730-97d2-f9fb3cf8c9a0">
Aug 10 00:46:30 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 10 00:46:30 user nova-compute[73029]:         </nova:port>
Aug 10 00:46:30 user nova-compute[73029]:       </nova:ports>
Aug 10 00:46:30 user nova-compute[73029]:     </nova:instance>
Aug 10 00:46:30 user nova-compute[73029]:   </metadata>
Aug 10 00:46:30 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:46:30 user nova-compute[73029]:     <system>
Aug 10 00:46:30 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:46:30 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:46:30 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:46:30 user nova-compute[73029]:       <entry name="serial">a759a046-b39b-4c7d-88ce-bf6922af5a81</entry>
Aug 10 00:46:30 user nova-compute[73029]:       <entry name="uuid">a759a046-b39b-4c7d-88ce-bf6922af5a81</entry>
Aug 10 00:46:30 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:46:30 user nova-compute[73029]:     </system>
Aug 10 00:46:30 user nova-compute[73029]:   </sysinfo>
Aug 10 00:46:30 user nova-compute[73029]:   <os>
Aug 10 00:46:30 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:46:30 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:46:30 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:46:30 user nova-compute[73029]:   </os>
Aug 10 00:46:30 user nova-compute[73029]:   <features>
Aug 10 00:46:30 user nova-compute[73029]:     <acpi/>
Aug 10 00:46:30 user nova-compute[73029]:     <apic/>
Aug 10 00:46:30 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:46:30 user nova-compute[73029]:   </features>
Aug 10 00:46:30 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:46:30 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:46:30 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:46:30 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:46:30 user nova-compute[73029]:   </clock>
Aug 10 00:46:30 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:46:30 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:46:30 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:46:30 user nova-compute[73029]:   </cpu>
Aug 10 00:46:30 user nova-compute[73029]:   <devices>
Aug 10 00:46:30 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:46:30 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:46:30 user nova-compute[73029]:       <source dev="/dev/sdc"/>
Aug 10 00:46:30 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:46:30 user nova-compute[73029]:       <serial>bb934ac5-976b-4e1f-8572-2a365db9d227</serial>
Aug 10 00:46:30 user nova-compute[73029]:     </disk>
Aug 10 00:46:30 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:46:30 user nova-compute[73029]:       <mac address="fa:16:3e:cf:99:04"/>
Aug 10 00:46:30 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:46:30 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:46:30 user nova-compute[73029]:       <target dev="tap24e98d91-db"/>
Aug 10 00:46:30 user nova-compute[73029]:     </interface>
Aug 10 00:46:30 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:46:30 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/a759a046-b39b-4c7d-88ce-bf6922af5a81/console.log" append="off"/>
Aug 10 00:46:30 user nova-compute[73029]:     </serial>
Aug 10 00:46:30 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:46:30 user nova-compute[73029]:     <video>
Aug 10 00:46:30 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:46:30 user nova-compute[73029]:     </video>
Aug 10 00:46:30 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:46:30 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:46:30 user nova-compute[73029]:     </rng>
Aug 10 00:46:30 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:46:30 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:46:30 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:46:30 user nova-compute[73029]:     </memballoon>
Aug 10 00:46:30 user nova-compute[73029]:   </devices>
Aug 10 00:46:30 user nova-compute[73029]: </domain>
Aug 10 00:46:30 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-774975152',display_name='tempest-ServerActionsTestOtherA-server-774975152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-774975152',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-6uqo1cb0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=a759a046-b39b-4c7d-88ce-bf6922af5a81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-310216871-network", "vif_mac": "fa:16:3e:cf:99:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-310216871-network", "vif_mac": "fa:16:3e:cf:99:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG os_vif [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24e98d91-db, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24e98d91-db, col_values=(('external_ids', {'iface-id': '24e98d91-db37-4730-97d2-f9fb3cf8c9a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:99:04', 'vm-uuid': 'a759a046-b39b-4c7d-88ce-bf6922af5a81'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:30 user nova-compute[73029]: INFO os_vif [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db')
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:46:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] No VIF found with MAC fa:16:3e:cf:99:04, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:46:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-d1077030-840b-48f1-9bd8-cbcb406046dc req-0c83eec0-fb02-4b1a-b520-78724cae3648 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d1077030-840b-48f1-9bd8-cbcb406046dc req-0c83eec0-fb02-4b1a-b520-78724cae3648 service nova] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d1077030-840b-48f1-9bd8-cbcb406046dc req-0c83eec0-fb02-4b1a-b520-78724cae3648 service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d1077030-840b-48f1-9bd8-cbcb406046dc req-0c83eec0-fb02-4b1a-b520-78724cae3648 service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-d1077030-840b-48f1-9bd8-cbcb406046dc req-0c83eec0-fb02-4b1a-b520-78724cae3648 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] No waiting events found dispatching network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:31 user nova-compute[73029]: WARNING nova.compute.manager [req-d1077030-840b-48f1-9bd8-cbcb406046dc req-0c83eec0-fb02-4b1a-b520-78724cae3648 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received unexpected event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 for instance with vm_state active and task_state resize_finish.
Aug 10 00:46:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:32 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628377.4291818, a759a046-b39b-4c7d-88ce-bf6922af5a81 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:46:32 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] VM Stopped (Lifecycle Event)
Aug 10 00:46:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1c64b6ea-86bf-4298-845d-2b09b7d106d2 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:33 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628393.963773, a759a046-b39b-4c7d-88ce-bf6922af5a81 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:46:33 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] VM Resumed (Lifecycle Event)
Aug 10 00:46:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:46:33 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Instance running successfully.
Aug 10 00:46:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Failed to set time: agent not configured {{(pid=73029) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 10 00:46:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ec5e132c-53a6-462c-9f60-2fbcaba010b7 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] finish_migration finished successfully. {{(pid=73029) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 10 00:46:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:46:34 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 10 00:46:34 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628393.9654691, a759a046-b39b-4c7d-88ce-bf6922af5a81 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:46:34 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] VM Started (Lifecycle Event)
Aug 10 00:46:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-ed3d407c-d652-40d9-a2b9-0248a842a053 req-096ab9c1-380e-49d6-89b0-e5452bdfa957 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ed3d407c-d652-40d9-a2b9-0248a842a053 req-096ab9c1-380e-49d6-89b0-e5452bdfa957 service nova] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ed3d407c-d652-40d9-a2b9-0248a842a053 req-096ab9c1-380e-49d6-89b0-e5452bdfa957 service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ed3d407c-d652-40d9-a2b9-0248a842a053 req-096ab9c1-380e-49d6-89b0-e5452bdfa957 service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-ed3d407c-d652-40d9-a2b9-0248a842a053 req-096ab9c1-380e-49d6-89b0-e5452bdfa957 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] No waiting events found dispatching network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:34 user nova-compute[73029]: WARNING nova.compute.manager [req-ed3d407c-d652-40d9-a2b9-0248a842a053 req-096ab9c1-380e-49d6-89b0-e5452bdfa957 service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received unexpected event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 for instance with vm_state active and task_state resize_finish.
Aug 10 00:46:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:46:34 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 10 00:46:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:39 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628384.22744, 872fce9b-adf0-4c6f-820e-0d76b59ea36d => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:46:39 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] VM Stopped (Lifecycle Event)
Aug 10 00:46:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9be0205c-1650-4c4e-8fd5-5806036c2317 None None] [instance: 872fce9b-adf0-4c6f-820e-0d76b59ea36d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:46:41 user nova-compute[73029]: INFO nova.compute.manager [None req-0361a2c4-4ac9-48fa-b5e5-f9cc1efe21be tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Unrescuing
Aug 10 00:46:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0361a2c4-4ac9-48fa-b5e5-f9cc1efe21be tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:46:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0361a2c4-4ac9-48fa-b5e5-f9cc1efe21be tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquired lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:46:41 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0361a2c4-4ac9-48fa-b5e5-f9cc1efe21be tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:46:42 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0361a2c4-4ac9-48fa-b5e5-f9cc1efe21be tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updating instance_info_cache with network_info: [{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:46:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0361a2c4-4ac9-48fa-b5e5-f9cc1efe21be tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Releasing lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:46:42 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0361a2c4-4ac9-48fa-b5e5-f9cc1efe21be tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'flavor' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:46:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-7c4b5243-c6d8-42fd-915a-f241308b9467 req-fb3e962e-dcfc-4bad-a2ab-fe83fbb93768 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-unplugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7c4b5243-c6d8-42fd-915a-f241308b9467 req-fb3e962e-dcfc-4bad-a2ab-fe83fbb93768 service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7c4b5243-c6d8-42fd-915a-f241308b9467 req-fb3e962e-dcfc-4bad-a2ab-fe83fbb93768 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7c4b5243-c6d8-42fd-915a-f241308b9467 req-fb3e962e-dcfc-4bad-a2ab-fe83fbb93768 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-7c4b5243-c6d8-42fd-915a-f241308b9467 req-fb3e962e-dcfc-4bad-a2ab-fe83fbb93768 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-unplugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:43 user nova-compute[73029]: WARNING nova.compute.manager [req-7c4b5243-c6d8-42fd-915a-f241308b9467 req-fb3e962e-dcfc-4bad-a2ab-fe83fbb93768 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-unplugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:46:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:43 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Instance destroyed successfully.
Aug 10 00:46:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-4aa7748f-4579-4bec-a529-b73498b6e080 req-1ea33603-6499-4ca3-8705-ed02fd510978 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4aa7748f-4579-4bec-a529-b73498b6e080 req-1ea33603-6499-4ca3-8705-ed02fd510978 service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4aa7748f-4579-4bec-a529-b73498b6e080 req-1ea33603-6499-4ca3-8705-ed02fd510978 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4aa7748f-4579-4bec-a529-b73498b6e080 req-1ea33603-6499-4ca3-8705-ed02fd510978 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-4aa7748f-4579-4bec-a529-b73498b6e080 req-1ea33603-6499-4ca3-8705-ed02fd510978 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:45 user nova-compute[73029]: WARNING nova.compute.manager [req-4aa7748f-4579-4bec-a529-b73498b6e080 req-1ea33603-6499-4ca3-8705-ed02fd510978 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:46:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for a2f85a2f-0bb4-4020-9260-98f866f5c9f6 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628407.1394088, a2f85a2f-0bb4-4020-9260-98f866f5c9f6 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:46:47 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] VM Resumed (Lifecycle Event)
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0361a2c4-4ac9-48fa-b5e5-f9cc1efe21be tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:46:47 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628407.1403255, a2f85a2f-0bb4-4020-9260-98f866f5c9f6 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:46:47 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] VM Started (Lifecycle Event)
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:47 user nova-compute[73029]: WARNING nova.compute.manager [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:47 user nova-compute[73029]: WARNING nova.compute.manager [req-67e7e307-5261-4964-b5e6-9714d0304ccf req-f3639843-a63c-4f47-9b36-cdc8089df181 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:46:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:46:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:46:52 user nova-compute[73029]: INFO nova.compute.claims [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Claim successful on node user
Aug 10 00:46:53 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG nova.network.neutron [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:46:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:46:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG nova.policy [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad4b1f5525d54f399db688f2ff7f0752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ec174542da4ef6ac5751fb12c9f808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:46:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Creating image(s)
Aug 10 00:46:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "/opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "/opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "/opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.243s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk 1073741824" returned: 0 in 0.051s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG nova.network.neutron [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Successfully created port: a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Cannot resize image /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG nova.objects.instance [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'migration_context' on Instance uuid bda1d893-0d5b-46da-9f32-b0e2402c28aa {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Ensure instance console log exists: /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.network.neutron [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Successfully updated port: a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "refresh_cache-bda1d893-0d5b-46da-9f32-b0e2402c28aa" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquired lock "refresh_cache-bda1d893-0d5b-46da-9f32-b0e2402c28aa" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.network.neutron [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-668e251f-3142-4890-beb1-c071332e63c6 req-0b3767a6-628b-468e-9652-7a70b7963ca8 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received event network-changed-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-668e251f-3142-4890-beb1-c071332e63c6 req-0b3767a6-628b-468e-9652-7a70b7963ca8 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Refreshing instance network info cache due to event network-changed-a6681947-5c76-41a4-9552-65c920662ec7. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-668e251f-3142-4890-beb1-c071332e63c6 req-0b3767a6-628b-468e-9652-7a70b7963ca8 service nova] Acquiring lock "refresh_cache-bda1d893-0d5b-46da-9f32-b0e2402c28aa" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.network.neutron [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.network.neutron [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Updating instance_info_cache with network_info: [{"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Releasing lock "refresh_cache-bda1d893-0d5b-46da-9f32-b0e2402c28aa" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Instance network_info: |[{"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-668e251f-3142-4890-beb1-c071332e63c6 req-0b3767a6-628b-468e-9652-7a70b7963ca8 service nova] Acquired lock "refresh_cache-bda1d893-0d5b-46da-9f32-b0e2402c28aa" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.network.neutron [req-668e251f-3142-4890-beb1-c071332e63c6 req-0b3767a6-628b-468e-9652-7a70b7963ca8 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Refreshing network info cache for port a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Start _get_guest_xml network_info=[{"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:46:55 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:46:55 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:46:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1363642858',display_name='tempest-AttachVolumeNegativeTest-server-1363642858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1363642858',id=26,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhs88oeBqTqR+I5t0uhcLzwR0Ss77OBbGDh7eBdM2dDEk9bnvJjcKVW55zSITec32fXWIw9nVcT6Pk3igrAWZoygWJx3pBi+A+M87mqSKYL0Btb89rpnYoZXegEzgdLlw==',key_name='tempest-keypair-1548422185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-xml2xa05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:46:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=bda1d893-0d5b-46da-9f32-b0e2402c28aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:49:59,bridge_name='br-int',has_traffic_filtering=True,id=a6681947-5c76-41a4-9552-65c920662ec7,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6681947-5c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.objects.instance [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'pci_devices' on Instance uuid bda1d893-0d5b-46da-9f32-b0e2402c28aa {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:46:56 user nova-compute[73029]:   <uuid>bda1d893-0d5b-46da-9f32-b0e2402c28aa</uuid>
Aug 10 00:46:56 user nova-compute[73029]:   <name>instance-0000001a</name>
Aug 10 00:46:56 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:46:56 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:46:56 user nova-compute[73029]:   <metadata>
Aug 10 00:46:56 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:46:56 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:46:56 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1363642858</nova:name>
Aug 10 00:46:56 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:46:55</nova:creationTime>
Aug 10 00:46:56 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:46:56 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:46:56 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:46:56 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:46:56 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:46:56 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:46:56 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:46:56 user nova-compute[73029]:       <nova:owner>
Aug 10 00:46:56 user nova-compute[73029]:         <nova:user uuid="ad4b1f5525d54f399db688f2ff7f0752">tempest-AttachVolumeNegativeTest-685145765-project-member</nova:user>
Aug 10 00:46:56 user nova-compute[73029]:         <nova:project uuid="22ec174542da4ef6ac5751fb12c9f808">tempest-AttachVolumeNegativeTest-685145765</nova:project>
Aug 10 00:46:56 user nova-compute[73029]:       </nova:owner>
Aug 10 00:46:56 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:46:56 user nova-compute[73029]:       <nova:ports>
Aug 10 00:46:56 user nova-compute[73029]:         <nova:port uuid="a6681947-5c76-41a4-9552-65c920662ec7">
Aug 10 00:46:56 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 10 00:46:56 user nova-compute[73029]:         </nova:port>
Aug 10 00:46:56 user nova-compute[73029]:       </nova:ports>
Aug 10 00:46:56 user nova-compute[73029]:     </nova:instance>
Aug 10 00:46:56 user nova-compute[73029]:   </metadata>
Aug 10 00:46:56 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:46:56 user nova-compute[73029]:     <system>
Aug 10 00:46:56 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:46:56 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:46:56 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:46:56 user nova-compute[73029]:       <entry name="serial">bda1d893-0d5b-46da-9f32-b0e2402c28aa</entry>
Aug 10 00:46:56 user nova-compute[73029]:       <entry name="uuid">bda1d893-0d5b-46da-9f32-b0e2402c28aa</entry>
Aug 10 00:46:56 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:46:56 user nova-compute[73029]:     </system>
Aug 10 00:46:56 user nova-compute[73029]:   </sysinfo>
Aug 10 00:46:56 user nova-compute[73029]:   <os>
Aug 10 00:46:56 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:46:56 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:46:56 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:46:56 user nova-compute[73029]:   </os>
Aug 10 00:46:56 user nova-compute[73029]:   <features>
Aug 10 00:46:56 user nova-compute[73029]:     <acpi/>
Aug 10 00:46:56 user nova-compute[73029]:     <apic/>
Aug 10 00:46:56 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:46:56 user nova-compute[73029]:   </features>
Aug 10 00:46:56 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:46:56 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:46:56 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:46:56 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:46:56 user nova-compute[73029]:   </clock>
Aug 10 00:46:56 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:46:56 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:46:56 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:46:56 user nova-compute[73029]:   </cpu>
Aug 10 00:46:56 user nova-compute[73029]:   <devices>
Aug 10 00:46:56 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:46:56 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:46:56 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk"/>
Aug 10 00:46:56 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:46:56 user nova-compute[73029]:     </disk>
Aug 10 00:46:56 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:46:56 user nova-compute[73029]:       <mac address="fa:16:3e:05:49:59"/>
Aug 10 00:46:56 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:46:56 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:46:56 user nova-compute[73029]:       <target dev="tapa6681947-5c"/>
Aug 10 00:46:56 user nova-compute[73029]:     </interface>
Aug 10 00:46:56 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:46:56 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/console.log" append="off"/>
Aug 10 00:46:56 user nova-compute[73029]:     </serial>
Aug 10 00:46:56 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:46:56 user nova-compute[73029]:     <video>
Aug 10 00:46:56 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:46:56 user nova-compute[73029]:     </video>
Aug 10 00:46:56 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:46:56 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:46:56 user nova-compute[73029]:     </rng>
Aug 10 00:46:56 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:46:56 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:46:56 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:46:56 user nova-compute[73029]:     </memballoon>
Aug 10 00:46:56 user nova-compute[73029]:   </devices>
Aug 10 00:46:56 user nova-compute[73029]: </domain>
Aug 10 00:46:56 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1363642858',display_name='tempest-AttachVolumeNegativeTest-server-1363642858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1363642858',id=26,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhs88oeBqTqR+I5t0uhcLzwR0Ss77OBbGDh7eBdM2dDEk9bnvJjcKVW55zSITec32fXWIw9nVcT6Pk3igrAWZoygWJx3pBi+A+M87mqSKYL0Btb89rpnYoZXegEzgdLlw==',key_name='tempest-keypair-1548422185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-xml2xa05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:46:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=bda1d893-0d5b-46da-9f32-b0e2402c28aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:49:59,bridge_name='br-int',has_traffic_filtering=True,id=a6681947-5c76-41a4-9552-65c920662ec7,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6681947-5c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG os_vif [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:49:59,bridge_name='br-int',has_traffic_filtering=True,id=a6681947-5c76-41a4-9552-65c920662ec7,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6681947-5c') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6681947-5c, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6681947-5c, col_values=(('external_ids', {'iface-id': 'a6681947-5c76-41a4-9552-65c920662ec7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:49:59', 'vm-uuid': 'bda1d893-0d5b-46da-9f32-b0e2402c28aa'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:56 user nova-compute[73029]: INFO os_vif [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:49:59,bridge_name='br-int',has_traffic_filtering=True,id=a6681947-5c76-41a4-9552-65c920662ec7,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6681947-5c')
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No VIF found with MAC fa:16:3e:05:49:59, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.network.neutron [req-668e251f-3142-4890-beb1-c071332e63c6 req-0b3767a6-628b-468e-9652-7a70b7963ca8 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Updated VIF entry in instance network info cache for port a6681947-5c76-41a4-9552-65c920662ec7. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG nova.network.neutron [req-668e251f-3142-4890-beb1-c071332e63c6 req-0b3767a6-628b-468e-9652-7a70b7963ca8 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Updating instance_info_cache with network_info: [{"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:46:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-668e251f-3142-4890-beb1-c071332e63c6 req-0b3767a6-628b-468e-9652-7a70b7963ca8 service nova] Releasing lock "refresh_cache-bda1d893-0d5b-46da-9f32-b0e2402c28aa" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:46:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-addaca09-62b3-4b2e-aba1-913d41363c8d req-140f57ba-c951-40ec-b40b-7feec5d15588 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received event network-vif-plugged-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-addaca09-62b3-4b2e-aba1-913d41363c8d req-140f57ba-c951-40ec-b40b-7feec5d15588 service nova] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-addaca09-62b3-4b2e-aba1-913d41363c8d req-140f57ba-c951-40ec-b40b-7feec5d15588 service nova] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-addaca09-62b3-4b2e-aba1-913d41363c8d req-140f57ba-c951-40ec-b40b-7feec5d15588 service nova] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-addaca09-62b3-4b2e-aba1-913d41363c8d req-140f57ba-c951-40ec-b40b-7feec5d15588 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] No waiting events found dispatching network-vif-plugged-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:57 user nova-compute[73029]: WARNING nova.compute.manager [req-addaca09-62b3-4b2e-aba1-913d41363c8d req-140f57ba-c951-40ec-b40b-7feec5d15588 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received unexpected event network-vif-plugged-a6681947-5c76-41a4-9552-65c920662ec7 for instance with vm_state building and task_state spawning.
Aug 10 00:46:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628419.7209113, bda1d893-0d5b-46da-9f32-b0e2402c28aa => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:46:59 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] VM Resumed (Lifecycle Event)
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:46:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Instance spawned successfully.
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:46:59 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628419.7261057, bda1d893-0d5b-46da-9f32-b0e2402c28aa => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:46:59 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] VM Started (Lifecycle Event)
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-5c99d29c-de42-4af3-af31-e9deae5e186e req-f3daab88-8d32-473c-ad55-0d1fe489a267 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received event network-vif-plugged-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5c99d29c-de42-4af3-af31-e9deae5e186e req-f3daab88-8d32-473c-ad55-0d1fe489a267 service nova] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5c99d29c-de42-4af3-af31-e9deae5e186e req-f3daab88-8d32-473c-ad55-0d1fe489a267 service nova] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5c99d29c-de42-4af3-af31-e9deae5e186e req-f3daab88-8d32-473c-ad55-0d1fe489a267 service nova] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-5c99d29c-de42-4af3-af31-e9deae5e186e req-f3daab88-8d32-473c-ad55-0d1fe489a267 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] No waiting events found dispatching network-vif-plugged-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:46:59 user nova-compute[73029]: WARNING nova.compute.manager [req-5c99d29c-de42-4af3-af31-e9deae5e186e req-f3daab88-8d32-473c-ad55-0d1fe489a267 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received unexpected event network-vif-plugged-a6681947-5c76-41a4-9552-65c920662ec7 for instance with vm_state building and task_state spawning.
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:46:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:46:59 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:47:00 user nova-compute[73029]: INFO nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Took 6.36 seconds to spawn the instance on the hypervisor.
Aug 10 00:47:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:47:00 user nova-compute[73029]: INFO nova.compute.manager [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Took 7.16 seconds to build instance.
Aug 10 00:47:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-43a53ad7-8256-44b9-970c-35d7fa2fff4c tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.253s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:00 user nova-compute[73029]: DEBUG nova.network.neutron [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Port 7e775285-84c8-4049-9914-d6b201090b0a binding to destination host user is already ACTIVE {{(pid=73029) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 10 00:47:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:47:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquired lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:47:00 user nova-compute[73029]: DEBUG nova.network.neutron [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:47:00 user nova-compute[73029]: DEBUG nova.network.neutron [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance_info_cache with network_info: [{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:47:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Releasing lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:47:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Creating tmpfile /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/tmp8a0rly34 to verify with other compute node that the instance is on the same shared storage. {{(pid=73029) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 10 00:47:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:01 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance destroyed successfully.
Aug 10 00:47:01 user nova-compute[73029]: DEBUG nova.objects.instance [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'resources' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-269092502',display_name='tempest-ServerActionsTestOtherB-server-269092502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-269092502',id=19,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItzikrNamyVCnXNCeYWOUlFND2bQ8Tuk4qPbQ4GANcUlImEfJj3KUpqnSakA5oCLo1HOK7tJ0c86mCVYnqC3w/Zcx+l5l4Z97MDUOsNoNFHs+ZvBbIlKUjuqYy9iRb8Lw==',key_name='tempest-keypair-1753578335',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ad7b2647e5407b89ce46595c1fc9e8',ramdisk_id='',reservation_id='r-e1uzv60r',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539813810',owner_user_name='tempest-ServerActionsTestOtherB-539813810-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1bb9034314565893a8d3629f8cd0c',uuid=c4da58fe-aaf3-413d-aa56-48cf53e3a1d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converting VIF {"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_vif [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e775285-84, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:01 user nova-compute[73029]: INFO os_vif [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84')
Aug 10 00:47:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:01 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7452139-3e62-4ae0-8c7e-4ee4fd3cbc13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dfe775-4ff1-4f09-91b3-f861a99f5169]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:47:01 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:01 user nova-compute[73029]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:47:01 user nova-compute[73029]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:01 user nova-compute[73029]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f0669fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'): ({'sdd'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Removing single pathed devices sdd {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd21a62-a8ec-4bc4-921b-57821ef697c4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e0e080-1a3f-4098-a84d-5884d3f551ab]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Flushing IO for device /dev/sdd {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa21d86-af55-4047-be2d-9d18d381fa46]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-unplugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-unplugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:47:01 user nova-compute[73029]: WARNING nova.compute.manager [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-unplugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state resized and task_state resize_reverting.
Aug 10 00:47:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:47:01 user nova-compute[73029]: WARNING nova.compute.manager [req-b1a7892d-adda-493e-80e5-0cd80c162586 req-a5fb737d-7642-42b6-9da2-2741e88d8bc3 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state resized and task_state resize_reverting.
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[15649cd8-2610-4b88-8961-84cdeaaa1835]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3706818-879e-4a71-bb97-ba7187758414]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd75de7-a3cd-4e54-899c-b87ebc866411]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]
Aug 10 00:47:02 user nova-compute[73029]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.
Aug 10 00:47:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[327d02b3-834b-46d0-86a4-d0fcc8535722]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] <== disconnect_volume: return (317ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:47:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:03 user nova-compute[73029]: DEBUG nova.objects.instance [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'migration_context' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:03 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:47:03 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:47:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.400s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:03 user nova-compute[73029]: INFO nova.compute.manager [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Swapping old allocation on dict_keys(['78a3d833-6e7b-46db-90d0-fe7329a0c19a']) held by migration e13e83d3-6c8b-4c71-afb0-f0af16f06f45 for instance
Aug 10 00:47:03 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Overwriting current allocation {'allocations': {'78a3d833-6e7b-46db-90d0-fe7329a0c19a': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': '74ad7b2647e5407b89ce46595c1fc9e8', 'user_id': 'f3e1bb9034314565893a8d3629f8cd0c', 'consumer_generation': 1} on consumer c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 10 00:47:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:47:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquired lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:47:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG nova.network.neutron [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance_info_cache with network_info: [{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Releasing lock "refresh_cache-c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG os_brick.utils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[58922db9-2a11-43bf-8a77-258409941a8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[205cd43d-c206-4435-8c23-a1a8ef0a3b00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3726d6cb-f0cb-4db3-9b9e-12baf532a7b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de7789-d08e-4fe8-accf-ebebb11ca875]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:47:04 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:47:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f400b62-c5a8-4052-baa3-5bd9ef098f7b]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:47:04 user nova-compute[73029]: DEBUG os_brick.utils [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-49b28c24-9ceb-4d05-891c-1175555c9107 req-daa03868-bf69-4e89-9270-83cb5c74a524 service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received event network-changed-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-49b28c24-9ceb-4d05-891c-1175555c9107 req-daa03868-bf69-4e89-9270-83cb5c74a524 service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Refreshing instance network info cache due to event network-changed-4f8428d8-a469-452c-8218-cc53ca757d7b. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:47:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-49b28c24-9ceb-4d05-891c-1175555c9107 req-daa03868-bf69-4e89-9270-83cb5c74a524 service nova] Acquiring lock "refresh_cache-655f9889-40ea-416f-9df2-71838819c37b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:47:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-49b28c24-9ceb-4d05-891c-1175555c9107 req-daa03868-bf69-4e89-9270-83cb5c74a524 service nova] Acquired lock "refresh_cache-655f9889-40ea-416f-9df2-71838819c37b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:47:05 user nova-compute[73029]: DEBUG nova.network.neutron [req-49b28c24-9ceb-4d05-891c-1175555c9107 req-daa03868-bf69-4e89-9270-83cb5c74a524 service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Refreshing network info cache for port 4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG nova.network.neutron [req-49b28c24-9ceb-4d05-891c-1175555c9107 req-daa03868-bf69-4e89-9270-83cb5c74a524 service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Updated VIF entry in instance network info cache for port 4f8428d8-a469-452c-8218-cc53ca757d7b. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG nova.network.neutron [req-49b28c24-9ceb-4d05-891c-1175555c9107 req-daa03868-bf69-4e89-9270-83cb5c74a524 service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Updating instance_info_cache with network_info: [{"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-49b28c24-9ceb-4d05-891c-1175555c9107 req-daa03868-bf69-4e89-9270-83cb5c74a524 service nova] Releasing lock "refresh_cache-655f9889-40ea-416f-9df2-71838819c37b" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG nova.objects.instance [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lazy-loading 'flavor' on Instance uuid 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:06 user nova-compute[73029]: INFO nova.compute.manager [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Attaching volume 62a9ba99-b72f-48dc-b37c-1e5e0c6d922c to /dev/vdb
Aug 10 00:47:06 user nova-compute[73029]: DEBUG os_brick.utils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b254a9a-c8e6-4d3b-aa2b-c1e97c0e265f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0464135-1211-4fdf-b0a5-58d11d7c559a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[38350555-f50b-4d18-8fc5-da4ab47ce6c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee0f4df-50a0-4100-a515-097cb97181af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:47:06 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6d69ba-13d0-400a-8484-7dbea3396cf6]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG os_brick.utils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Updating existing volume attachment record: de5bb428-2c99-42a0-be23-26f37a1ea6c8 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-7b0d4f3c-3a1b-479d-917a-c9a9186b74a6 req-cb754451-3cd8-4b41-ae1e-334a7a6e1b9c service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-changed-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-7b0d4f3c-3a1b-479d-917a-c9a9186b74a6 req-cb754451-3cd8-4b41-ae1e-334a7a6e1b9c service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Refreshing instance network info cache due to event network-changed-969e1ff4-cb79-4f35-9121-d34f9ef7849d. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7b0d4f3c-3a1b-479d-917a-c9a9186b74a6 req-cb754451-3cd8-4b41-ae1e-334a7a6e1b9c service nova] Acquiring lock "refresh_cache-87bdf189-555c-4bf1-85cb-b5eed3753dca" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7b0d4f3c-3a1b-479d-917a-c9a9186b74a6 req-cb754451-3cd8-4b41-ae1e-334a7a6e1b9c service nova] Acquired lock "refresh_cache-87bdf189-555c-4bf1-85cb-b5eed3753dca" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:47:06 user nova-compute[73029]: DEBUG nova.network.neutron [req-7b0d4f3c-3a1b-479d-917a-c9a9186b74a6 req-cb754451-3cd8-4b41-ae1e-334a7a6e1b9c service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Refreshing network info cache for port 969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:47:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:07 user nova-compute[73029]: DEBUG nova.network.neutron [req-7b0d4f3c-3a1b-479d-917a-c9a9186b74a6 req-cb754451-3cd8-4b41-ae1e-334a7a6e1b9c service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Updated VIF entry in instance network info cache for port 969e1ff4-cb79-4f35-9121-d34f9ef7849d. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:47:07 user nova-compute[73029]: DEBUG nova.network.neutron [req-7b0d4f3c-3a1b-479d-917a-c9a9186b74a6 req-cb754451-3cd8-4b41-ae1e-334a7a6e1b9c service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Updating instance_info_cache with network_info: [{"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:47:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7b0d4f3c-3a1b-479d-917a-c9a9186b74a6 req-cb754451-3cd8-4b41-ae1e-334a7a6e1b9c service nova] Releasing lock "refresh_cache-87bdf189-555c-4bf1-85cb-b5eed3753dca" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:47:08 user nova-compute[73029]: INFO nova.compute.manager [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Rebuilding instance
Aug 10 00:47:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87bdf189-555c-4bf1-85cb-b5eed3753dca {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lazy-loading 'pci_requests' on Instance uuid 87bdf189-555c-4bf1-85cb-b5eed3753dca {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lazy-loading 'pci_devices' on Instance uuid 87bdf189-555c-4bf1-85cb-b5eed3753dca {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lazy-loading 'resources' on Instance uuid 87bdf189-555c-4bf1-85cb-b5eed3753dca {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lazy-loading 'migration_context' on Instance uuid 87bdf189-555c-4bf1-85cb-b5eed3753dca {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73029) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-3826a071-0a46-4e07-b9c4-5fb14342209d req-5c706dac-85a2-4175-90a8-7495e01f2b78 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-unplugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3826a071-0a46-4e07-b9c4-5fb14342209d req-5c706dac-85a2-4175-90a8-7495e01f2b78 service nova] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3826a071-0a46-4e07-b9c4-5fb14342209d req-5c706dac-85a2-4175-90a8-7495e01f2b78 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3826a071-0a46-4e07-b9c4-5fb14342209d req-5c706dac-85a2-4175-90a8-7495e01f2b78 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-3826a071-0a46-4e07-b9c4-5fb14342209d req-5c706dac-85a2-4175-90a8-7495e01f2b78 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] No waiting events found dispatching network-vif-unplugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:47:08 user nova-compute[73029]: WARNING nova.compute.manager [req-3826a071-0a46-4e07-b9c4-5fb14342209d req-5c706dac-85a2-4175-90a8-7495e01f2b78 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received unexpected event network-vif-unplugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d for instance with vm_state active and task_state rebuilding.
Aug 10 00:47:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:09 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance destroyed successfully.
Aug 10 00:47:09 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance destroyed successfully.
Aug 10 00:47:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1270266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-122230355',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn6b0RvSjlr4qzfZjVXoWj2PIrxciTiPOYgKZjzkDkC1B6RxtLw3DaUNafzuQ/VYtXasTgpZXLAj7T1zQ7bM8cO35G0xt5HXDWFvm+zHBR6fzyt5SgxtU/1uYGuUgWVjA==',key_name='tempest-keypair-1957671487',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='07258fd0d1784a0584f05238888556d7',ramdisk_id='',reservation_id='r-gc00zg80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1416245590',owner_user_name='tempest-ServerActionsV293TestJSON-1416245590-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:47:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28a10069ba1b486491a647c7aaec3324',uuid=87bdf189-555c-4bf1-85cb-b5eed3753dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converting VIF {"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_vif [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap969e1ff4-cb, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:47:09 user nova-compute[73029]: INFO os_vif [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb')
Aug 10 00:47:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRHeCZFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:09 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36ea3ef-1952-4efc-b1f7-d92eb61cd51e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cd6ef5-f58d-4b3f-850e-6c7de71c8822]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:47:09 user nova-compute[73029]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:47:09 user nova-compute[73029]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141a5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e788cf1b-7247-4b80-b693-adf153c38887]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[742ef59f-e2d5-40d9-9e94-fe01ab4c1ae4]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eaba96-150e-441c-9af0-4adba8b1d11d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c90368-d15b-455b-bd68-ac7cb42cb1bf]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9c79f26e-c9124f8b366353b2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9c79f26e', '/dev/disk/by-id/scsi-26339313234663862') {{(pid=84041) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[939a373b-338a-410f-b159-0397ae5529cd]: (4, None) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7798032-d4c1-4e72-a923-f80e093063ff]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd756b6-d132-4836-9d01-7505a7961e34]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260]
Aug 10 00:47:09 user nova-compute[73029]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260] successful.
Aug 10 00:47:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cc7715-414a-4247-9c8e-7ba79e789f26]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] <== disconnect_volume: return (327ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:47:09 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Deleting instance files /opt/stack/data/nova/instances/87bdf189-555c-4bf1-85cb-b5eed3753dca_del
Aug 10 00:47:09 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Deletion of /opt/stack/data/nova/instances/87bdf189-555c-4bf1-85cb-b5eed3753dca_del complete
Aug 10 00:47:09 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 87bdf189-555c-4bf1-85cb-b5eed3753dca could not be found.
Aug 10 00:47:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRHeCZFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:09 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[227157fa-27a7-4220-930e-2eac675c6a8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a23d591-39b2-4513-9dbb-a2caf86027ff]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7528c703a0>, {}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Disconnecting from: [] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] <== disconnect_volume: return (53ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:47:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Preparing to wait for external event volume-reimaged-e6cae31c-7aeb-4937-9ac3-38b62c30c710 {{(pid=73029) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 10 00:47:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-72f1ccad-1963-4c53-a5d7-24858474805f req-a7e6431f-0d27-441b-9e00-5df7c1dab9ef service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-72f1ccad-1963-4c53-a5d7-24858474805f req-a7e6431f-0d27-441b-9e00-5df7c1dab9ef service nova] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-72f1ccad-1963-4c53-a5d7-24858474805f req-a7e6431f-0d27-441b-9e00-5df7c1dab9ef service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-72f1ccad-1963-4c53-a5d7-24858474805f req-a7e6431f-0d27-441b-9e00-5df7c1dab9ef service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-72f1ccad-1963-4c53-a5d7-24858474805f req-a7e6431f-0d27-441b-9e00-5df7c1dab9ef service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] No event matching network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d in dict_keys([('volume-reimaged', 'e6cae31c-7aeb-4937-9ac3-38b62c30c710')]) {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 10 00:47:10 user nova-compute[73029]: WARNING nova.compute.manager [req-72f1ccad-1963-4c53-a5d7-24858474805f req-a7e6431f-0d27-441b-9e00-5df7c1dab9ef service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received unexpected event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d for instance with vm_state active and task_state rebuilding.
Aug 10 00:47:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Starting finish_revert_migration {{(pid=73029) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Start _get_guest_xml network_info=[{"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '497be115-0fbf-419c-ad29-44ba96576924', 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c4da58fe-aaf3-413d-aa56-48cf53e3a1d5', 'attached_at': '2023-08-10T00:47:15.000000', 'detached_at': '', 'volume_id': 'efab513d-9a6c-4422-8efc-501492f13fa4', 'serial': 'efab513d-9a6c-4422-8efc-501492f13fa4'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:47:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:47:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.objects.instance [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:14 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:47:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:14 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:47:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:14 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b419ae-7978-42d4-8658-d6c98e7ec471]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:47:14 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[155b5d45-8348-478b-942d-24c3815e1117]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4] added
Aug 10 00:47:14 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70892e2-86c5-4101-8b10-80a46c399f42]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72fec94-8fc9-474f-9242-db8c09499144]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjLUxpTM {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjLUxpTM" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[175da8a6-61b6-487b-ad71-8e98eb187ecc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjLUxpTM'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3c58e8-72bf-46a8-877f-f3961964462c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adcb577-a7e1-4cce-bac3-96ff85908f89]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:15 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:15 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c6786-4232-4e14-8876-1a25aae6ecf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]
Aug 10 00:47:15 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.
Aug 10 00:47:15 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d27111-6354-42bb-80da-38684c2d833a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[758f3af2-b075-40e9-a786-c6b17d8ff5a5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:15 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:15 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:15 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:15 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83100bd-eb71-42c6-84c2-867f7316e28f]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:15 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23639313237316231', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639313237316231', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-269092502',display_name='tempest-ServerActionsTestOtherB-server-269092502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-269092502',id=19,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItzikrNamyVCnXNCeYWOUlFND2bQ8Tuk4qPbQ4GANcUlImEfJj3KUpqnSakA5oCLo1HOK7tJ0c86mCVYnqC3w/Zcx+l5l4Z97MDUOsNoNFHs+ZvBbIlKUjuqYy9iRb8Lw==',key_name='tempest-keypair-1753578335',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74ad7b2647e5407b89ce46595c1fc9e8',ramdisk_id='',reservation_id='r-e1uzv60r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539813810',owner_user_name='tempest-ServerActionsTestOtherB-539813810-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1bb9034314565893a8d3629f8cd0c',uuid=c4da58fe-aaf3-413d-aa56-48cf53e3a1d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converting VIF {"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:47:16 user nova-compute[73029]:   <uuid>c4da58fe-aaf3-413d-aa56-48cf53e3a1d5</uuid>
Aug 10 00:47:16 user nova-compute[73029]:   <name>instance-00000013</name>
Aug 10 00:47:16 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:47:16 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:47:16 user nova-compute[73029]:   <metadata>
Aug 10 00:47:16 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:47:16 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:47:16 user nova-compute[73029]:       <nova:name>tempest-ServerActionsTestOtherB-server-269092502</nova:name>
Aug 10 00:47:16 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:47:14</nova:creationTime>
Aug 10 00:47:16 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:47:16 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:47:16 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:47:16 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:47:16 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:47:16 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:47:16 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:47:16 user nova-compute[73029]:       <nova:owner>
Aug 10 00:47:16 user nova-compute[73029]:         <nova:user uuid="f3e1bb9034314565893a8d3629f8cd0c">tempest-ServerActionsTestOtherB-539813810-project-member</nova:user>
Aug 10 00:47:16 user nova-compute[73029]:         <nova:project uuid="74ad7b2647e5407b89ce46595c1fc9e8">tempest-ServerActionsTestOtherB-539813810</nova:project>
Aug 10 00:47:16 user nova-compute[73029]:       </nova:owner>
Aug 10 00:47:16 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:47:16 user nova-compute[73029]:       <nova:ports>
Aug 10 00:47:16 user nova-compute[73029]:         <nova:port uuid="7e775285-84c8-4049-9914-d6b201090b0a">
Aug 10 00:47:16 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 00:47:16 user nova-compute[73029]:         </nova:port>
Aug 10 00:47:16 user nova-compute[73029]:       </nova:ports>
Aug 10 00:47:16 user nova-compute[73029]:     </nova:instance>
Aug 10 00:47:16 user nova-compute[73029]:   </metadata>
Aug 10 00:47:16 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:47:16 user nova-compute[73029]:     <system>
Aug 10 00:47:16 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:47:16 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:47:16 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:47:16 user nova-compute[73029]:       <entry name="serial">c4da58fe-aaf3-413d-aa56-48cf53e3a1d5</entry>
Aug 10 00:47:16 user nova-compute[73029]:       <entry name="uuid">c4da58fe-aaf3-413d-aa56-48cf53e3a1d5</entry>
Aug 10 00:47:16 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:47:16 user nova-compute[73029]:     </system>
Aug 10 00:47:16 user nova-compute[73029]:   </sysinfo>
Aug 10 00:47:16 user nova-compute[73029]:   <os>
Aug 10 00:47:16 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:47:16 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:47:16 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:47:16 user nova-compute[73029]:   </os>
Aug 10 00:47:16 user nova-compute[73029]:   <features>
Aug 10 00:47:16 user nova-compute[73029]:     <acpi/>
Aug 10 00:47:16 user nova-compute[73029]:     <apic/>
Aug 10 00:47:16 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:47:16 user nova-compute[73029]:   </features>
Aug 10 00:47:16 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:47:16 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:47:16 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:47:16 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:47:16 user nova-compute[73029]:   </clock>
Aug 10 00:47:16 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:47:16 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:47:16 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:47:16 user nova-compute[73029]:   </cpu>
Aug 10 00:47:16 user nova-compute[73029]:   <devices>
Aug 10 00:47:16 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:47:16 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:47:16 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk"/>
Aug 10 00:47:16 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:47:16 user nova-compute[73029]:     </disk>
Aug 10 00:47:16 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:47:16 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:47:16 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 00:47:16 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:47:16 user nova-compute[73029]:       <serial>efab513d-9a6c-4422-8efc-501492f13fa4</serial>
Aug 10 00:47:16 user nova-compute[73029]:     </disk>
Aug 10 00:47:16 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:47:16 user nova-compute[73029]:       <mac address="fa:16:3e:6b:32:5a"/>
Aug 10 00:47:16 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:47:16 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:47:16 user nova-compute[73029]:       <target dev="tap7e775285-84"/>
Aug 10 00:47:16 user nova-compute[73029]:     </interface>
Aug 10 00:47:16 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:47:16 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/console.log" append="off"/>
Aug 10 00:47:16 user nova-compute[73029]:     </serial>
Aug 10 00:47:16 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:47:16 user nova-compute[73029]:     <video>
Aug 10 00:47:16 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:47:16 user nova-compute[73029]:     </video>
Aug 10 00:47:16 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:47:16 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:47:16 user nova-compute[73029]:     </rng>
Aug 10 00:47:16 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:47:16 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:47:16 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:47:16 user nova-compute[73029]:     </memballoon>
Aug 10 00:47:16 user nova-compute[73029]:   </devices>
Aug 10 00:47:16 user nova-compute[73029]: </domain>
Aug 10 00:47:16 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-269092502',display_name='tempest-ServerActionsTestOtherB-server-269092502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-269092502',id=19,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItzikrNamyVCnXNCeYWOUlFND2bQ8Tuk4qPbQ4GANcUlImEfJj3KUpqnSakA5oCLo1HOK7tJ0c86mCVYnqC3w/Zcx+l5l4Z97MDUOsNoNFHs+ZvBbIlKUjuqYy9iRb8Lw==',key_name='tempest-keypair-1753578335',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74ad7b2647e5407b89ce46595c1fc9e8',ramdisk_id='',reservation_id='r-e1uzv60r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539813810',owner_user_name='tempest-ServerActionsTestOtherB-539813810-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1bb9034314565893a8d3629f8cd0c',uuid=c4da58fe-aaf3-413d-aa56-48cf53e3a1d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converting VIF {"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_vif [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e775285-84, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e775285-84, col_values=(('external_ids', {'iface-id': '7e775285-84c8-4049-9914-d6b201090b0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:32:5a', 'vm-uuid': 'c4da58fe-aaf3-413d-aa56-48cf53e3a1d5'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:16 user nova-compute[73029]: INFO os_vif [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84')
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDyxnQJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:16 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:16 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:16 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bd3781-e2f0-486e-9847-1f736f040ed3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:47:16 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777e048-0692-4a90-9a6f-0d0185466f13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c] added
Aug 10 00:47:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0162b6a8-db91-439b-be51-1597cda83c5e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d6110a-5b15-459f-acaf-e6a704f96643]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDyxnQJr {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDyxnQJr" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a1c37-da13-4f58-9200-71298553a1f7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mDyxnQJr'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ffcc9-aa22-4d34-981c-3bb2d412443f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00b2409-1f07-4181-96c4-65140ff0754b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:16 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:16 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f393ac04-10ef-487d-b21b-5cb9561bbd9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c, portal: 172.16.0.220,3260]
Aug 10 00:47:16 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c, portal: 172.16.0.220,3260] successful.
Aug 10 00:47:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[560b3cda-abc9-47c9-99cb-6b2c7b4c0b69]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260149b-a52a-4c3c-96c6-ab97d8d7f60b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:16 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:16 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:47:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:16 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:16 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:47:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628421.7090256, c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:47:16 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] VM Stopped (Lifecycle Event)
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebdd586-02fb-411a-82ed-0ae12c9dc38c]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDyxnQJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:47:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9d8ec01c-80c9-4b17-b758-5ef54e6e2622 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:47:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23666633066336331', 'path': '/dev/sdd'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666633066336331', 'path': '/dev/sdd'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:47:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lazy-loading 'flavor' on Instance uuid 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:47:17 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:47:17 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:47:17 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:47:17 user nova-compute[73029]:   <serial>62a9ba99-b72f-48dc-b37c-1e5e0c6d922c</serial>
Aug 10 00:47:17 user nova-compute[73029]: </disk>
Aug 10 00:47:17 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-3f0c330f-01b9-47d0-bd20-fc86e2648091 req-331b23b9-d4fb-42ee-90db-fede0bddb184 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3f0c330f-01b9-47d0-bd20-fc86e2648091 req-331b23b9-d4fb-42ee-90db-fede0bddb184 service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3f0c330f-01b9-47d0-bd20-fc86e2648091 req-331b23b9-d4fb-42ee-90db-fede0bddb184 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3f0c330f-01b9-47d0-bd20-fc86e2648091 req-331b23b9-d4fb-42ee-90db-fede0bddb184 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-3f0c330f-01b9-47d0-bd20-fc86e2648091 req-331b23b9-d4fb-42ee-90db-fede0bddb184 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:47:18 user nova-compute[73029]: WARNING nova.compute.manager [req-3f0c330f-01b9-47d0-bd20-fc86e2648091 req-331b23b9-d4fb-42ee-90db-fede0bddb184 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state resized and task_state resize_reverting.
Aug 10 00:47:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:47:18 user nova-compute[73029]: INFO nova.compute.claims [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Claim successful on node user
Aug 10 00:47:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] No VIF found with MAC fa:16:3e:13:83:00, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-44552c89-5120-43e5-8061-9612fc126688 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.933s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:47:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:47:18 user nova-compute[73029]: DEBUG nova.policy [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4fd570e277240d1b7c1b910a9289aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdf72afe44346ebae59db7a6d57a787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:47:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:47:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:47:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Creating image(s)
Aug 10 00:47:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "/opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "/opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "/opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "558cfd98875bd8be74e883813cede1ffc8122167" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "558cfd98875bd8be74e883813cede1ffc8122167" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-802cfdcc-3413-46b8-bd30-49e67ec6049d req-5d121cb2-c39d-4607-9f37-093a25fecca1 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-802cfdcc-3413-46b8-bd30-49e67ec6049d req-5d121cb2-c39d-4607-9f37-093a25fecca1 service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-802cfdcc-3413-46b8-bd30-49e67ec6049d req-5d121cb2-c39d-4607-9f37-093a25fecca1 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-802cfdcc-3413-46b8-bd30-49e67ec6049d req-5d121cb2-c39d-4607-9f37-093a25fecca1 service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-802cfdcc-3413-46b8-bd30-49e67ec6049d req-5d121cb2-c39d-4607-9f37-093a25fecca1 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:47:20 user nova-compute[73029]: WARNING nova.compute.manager [req-802cfdcc-3413-46b8-bd30-49e67ec6049d req-5d121cb2-c39d-4607-9f37-093a25fecca1 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state resized and task_state resize_reverting.
Aug 10 00:47:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Successfully created port: ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167.part --force-share --output=json" returned: 0 in 0.179s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG nova.virt.images [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] 867a2fd6-5894-4597-bc89-2a4e567660fa was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167.part /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167.part /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167.converted" returned: 0 in 0.467s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "558cfd98875bd8be74e883813cede1ffc8122167" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.937s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Successfully updated port: ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167 --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "558cfd98875bd8be74e883813cede1ffc8122167" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "558cfd98875bd8be74e883813cede1ffc8122167" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628441.1482227, c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:47:21 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] VM Resumed (Lifecycle Event)
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-a75ce488-5e55-464e-9618-69c76678ad36 req-71da4f1f-4319-43cd-9994-a9a3dd02798f service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-a75ce488-5e55-464e-9618-69c76678ad36 req-71da4f1f-4319-43cd-9994-a9a3dd02798f service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing instance network info cache due to event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a75ce488-5e55-464e-9618-69c76678ad36 req-71da4f1f-4319-43cd-9994-a9a3dd02798f service nova] Acquiring lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a75ce488-5e55-464e-9618-69c76678ad36 req-71da4f1f-4319-43cd-9994-a9a3dd02798f service nova] Acquired lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-a75ce488-5e55-464e-9618-69c76678ad36 req-71da4f1f-4319-43cd-9994-a9a3dd02798f service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing network info cache for port ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:47:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance running successfully.
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] finish_revert_migration finished successfully. {{(pid=73029) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:47:21 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628441.1500232, c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:47:21 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] VM Started (Lifecycle Event)
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-a75ce488-5e55-464e-9618-69c76678ad36 req-71da4f1f-4319-43cd-9994-a9a3dd02798f service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167 --force-share --output=json" returned: 0 in 0.179s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167,backing_fmt=raw /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167,backing_fmt=raw /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk 1073741824" returned: 0 in 0.097s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "558cfd98875bd8be74e883813cede1ffc8122167" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:21 user nova-compute[73029]: INFO nova.compute.manager [None req-cd684005-7a65-4df3-bdb0-d5e1a2e4e93a tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance to original state: 'active'
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-a75ce488-5e55-464e-9618-69c76678ad36 req-71da4f1f-4319-43cd-9994-a9a3dd02798f service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:47:21 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a75ce488-5e55-464e-9618-69c76678ad36 req-71da4f1f-4319-43cd-9994-a9a3dd02798f service nova] Releasing lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquired lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167 --force-share --output=json" returned: 0 in 0.160s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Cannot resize image /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'migration_context' on Instance uuid 6138a253-2316-4468-b8f9-9268b1b4ded1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Ensure instance console log exists: /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [{"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Releasing lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Instance network_info: |[{"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Start _get_guest_xml network_info=[{"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:47:15Z,direct_url=<?>,disk_format='qcow2',id=867a2fd6-5894-4597-bc89-2a4e567660fa,min_disk=0,min_ram=0,name='tempest-scenario-img--614736753',owner='2bdf72afe44346ebae59db7a6d57a787',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:47:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '867a2fd6-5894-4597-bc89-2a4e567660fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:47:22 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:47:22 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:47:15Z,direct_url=<?>,disk_format='qcow2',id=867a2fd6-5894-4597-bc89-2a4e567660fa,min_disk=0,min_ram=0,name='tempest-scenario-img--614736753',owner='2bdf72afe44346ebae59db7a6d57a787',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:47:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:47:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-199595920',display_name='tempest-TestMinimumBasicScenario-server-199595920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-199595920',id=27,image_ref='867a2fd6-5894-4597-bc89-2a4e567660fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3nPY4y1tXFz/1IDzjZWrun+N++XmsSFS4lk+ZcytxppraToHdYuIVhKBP9QJU4yfZs3BSfm7x3a/uIwYlUwL9r/ejn0Q4GSSdFaoH0wJpAefVKifWjrqIEbMOWtS3JFA==',key_name='tempest-TestMinimumBasicScenario-1630418481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bdf72afe44346ebae59db7a6d57a787',ramdisk_id='',reservation_id='r-01xh3cqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='867a2fd6-5894-4597-bc89-2a4e567660fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-379185014',owner_user_name='tempest-TestMinimumBasicScenario-379185014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:47:19Z,user_data=None,user_id='e4fd570e277240d1b7c1b910a9289aad',uuid=6138a253-2316-4468-b8f9-9268b1b4ded1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converting VIF {"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:33,bridge_name='br-int',has_traffic_filtering=True,id=ed2decd6-a50d-42f6-9fdf-c08b0e87db91,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2decd6-a5') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'pci_devices' on Instance uuid 6138a253-2316-4468-b8f9-9268b1b4ded1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:47:22 user nova-compute[73029]:   <uuid>6138a253-2316-4468-b8f9-9268b1b4ded1</uuid>
Aug 10 00:47:22 user nova-compute[73029]:   <name>instance-0000001b</name>
Aug 10 00:47:22 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:47:22 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:47:22 user nova-compute[73029]:   <metadata>
Aug 10 00:47:22 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:47:22 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:47:22 user nova-compute[73029]:       <nova:name>tempest-TestMinimumBasicScenario-server-199595920</nova:name>
Aug 10 00:47:22 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:47:22</nova:creationTime>
Aug 10 00:47:22 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:47:22 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:47:22 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:47:22 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:47:22 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:47:22 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:47:22 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:47:22 user nova-compute[73029]:       <nova:owner>
Aug 10 00:47:22 user nova-compute[73029]:         <nova:user uuid="e4fd570e277240d1b7c1b910a9289aad">tempest-TestMinimumBasicScenario-379185014-project-member</nova:user>
Aug 10 00:47:22 user nova-compute[73029]:         <nova:project uuid="2bdf72afe44346ebae59db7a6d57a787">tempest-TestMinimumBasicScenario-379185014</nova:project>
Aug 10 00:47:22 user nova-compute[73029]:       </nova:owner>
Aug 10 00:47:22 user nova-compute[73029]:       <nova:root type="image" uuid="867a2fd6-5894-4597-bc89-2a4e567660fa"/>
Aug 10 00:47:22 user nova-compute[73029]:       <nova:ports>
Aug 10 00:47:22 user nova-compute[73029]:         <nova:port uuid="ed2decd6-a50d-42f6-9fdf-c08b0e87db91">
Aug 10 00:47:22 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 10 00:47:22 user nova-compute[73029]:         </nova:port>
Aug 10 00:47:22 user nova-compute[73029]:       </nova:ports>
Aug 10 00:47:22 user nova-compute[73029]:     </nova:instance>
Aug 10 00:47:22 user nova-compute[73029]:   </metadata>
Aug 10 00:47:22 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:47:22 user nova-compute[73029]:     <system>
Aug 10 00:47:22 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:47:22 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:47:22 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:47:22 user nova-compute[73029]:       <entry name="serial">6138a253-2316-4468-b8f9-9268b1b4ded1</entry>
Aug 10 00:47:22 user nova-compute[73029]:       <entry name="uuid">6138a253-2316-4468-b8f9-9268b1b4ded1</entry>
Aug 10 00:47:22 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:47:22 user nova-compute[73029]:     </system>
Aug 10 00:47:22 user nova-compute[73029]:   </sysinfo>
Aug 10 00:47:22 user nova-compute[73029]:   <os>
Aug 10 00:47:22 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:47:22 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:47:22 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:47:22 user nova-compute[73029]:   </os>
Aug 10 00:47:22 user nova-compute[73029]:   <features>
Aug 10 00:47:22 user nova-compute[73029]:     <acpi/>
Aug 10 00:47:22 user nova-compute[73029]:     <apic/>
Aug 10 00:47:22 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:47:22 user nova-compute[73029]:   </features>
Aug 10 00:47:22 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:47:22 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:47:22 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:47:22 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:47:22 user nova-compute[73029]:   </clock>
Aug 10 00:47:22 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:47:22 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:47:22 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:47:22 user nova-compute[73029]:   </cpu>
Aug 10 00:47:22 user nova-compute[73029]:   <devices>
Aug 10 00:47:22 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:47:22 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:47:22 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk"/>
Aug 10 00:47:22 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:47:22 user nova-compute[73029]:     </disk>
Aug 10 00:47:22 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:47:22 user nova-compute[73029]:       <mac address="fa:16:3e:f9:e9:33"/>
Aug 10 00:47:22 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:47:22 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:47:22 user nova-compute[73029]:       <target dev="taped2decd6-a5"/>
Aug 10 00:47:22 user nova-compute[73029]:     </interface>
Aug 10 00:47:22 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:47:22 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/console.log" append="off"/>
Aug 10 00:47:22 user nova-compute[73029]:     </serial>
Aug 10 00:47:22 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:47:22 user nova-compute[73029]:     <video>
Aug 10 00:47:22 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:47:22 user nova-compute[73029]:     </video>
Aug 10 00:47:22 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:47:22 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:47:22 user nova-compute[73029]:     </rng>
Aug 10 00:47:22 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:47:22 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:47:22 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:47:22 user nova-compute[73029]:     </memballoon>
Aug 10 00:47:22 user nova-compute[73029]:   </devices>
Aug 10 00:47:22 user nova-compute[73029]: </domain>
Aug 10 00:47:22 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:47:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-199595920',display_name='tempest-TestMinimumBasicScenario-server-199595920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-199595920',id=27,image_ref='867a2fd6-5894-4597-bc89-2a4e567660fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3nPY4y1tXFz/1IDzjZWrun+N++XmsSFS4lk+ZcytxppraToHdYuIVhKBP9QJU4yfZs3BSfm7x3a/uIwYlUwL9r/ejn0Q4GSSdFaoH0wJpAefVKifWjrqIEbMOWtS3JFA==',key_name='tempest-TestMinimumBasicScenario-1630418481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bdf72afe44346ebae59db7a6d57a787',ramdisk_id='',reservation_id='r-01xh3cqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='867a2fd6-5894-4597-bc89-2a4e567660fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-379185014',owner_user_name='tempest-TestMinimumBasicScenario-379185014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:47:19Z,user_data=None,user_id='e4fd570e277240d1b7c1b910a9289aad',uuid=6138a253-2316-4468-b8f9-9268b1b4ded1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converting VIF {"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:33,bridge_name='br-int',has_traffic_filtering=True,id=ed2decd6-a50d-42f6-9fdf-c08b0e87db91,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2decd6-a5') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG os_vif [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:33,bridge_name='br-int',has_traffic_filtering=True,id=ed2decd6-a50d-42f6-9fdf-c08b0e87db91,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2decd6-a5') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped2decd6-a5, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped2decd6-a5, col_values=(('external_ids', {'iface-id': 'ed2decd6-a50d-42f6-9fdf-c08b0e87db91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:e9:33', 'vm-uuid': '6138a253-2316-4468-b8f9-9268b1b4ded1'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:47:22 user nova-compute[73029]: INFO os_vif [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:33,bridge_name='br-int',has_traffic_filtering=True,id=ed2decd6-a50d-42f6-9fdf-c08b0e87db91,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2decd6-a5')
Aug 10 00:47:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:47:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No VIF found with MAC fa:16:3e:f9:e9:33, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG nova.objects.instance [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lazy-loading 'flavor' on Instance uuid 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:23 user nova-compute[73029]: INFO nova.compute.manager [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Attaching volume 25197b71-48f1-46ca-a699-6153d471b41d to /dev/vdc
Aug 10 00:47:23 user nova-compute[73029]: DEBUG os_brick.utils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed96019-cdd3-49c1-a02d-b5714a44a704]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50a3393-d3a4-4c84-8f95-e8ee038985f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a28def2-ff1e-414b-b8ed-0cf4eaef2768]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[84475caf-2909-4b43-9fae-5922c63389e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628429.0351949, 87bdf189-555c-4bf1-85cb-b5eed3753dca => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:47:24 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] VM Stopped (Lifecycle Event)
Aug 10 00:47:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-d1a5d99d-e8fb-4609-9156-795e1530efef req-4e63be73-f2f5-46b2-b9e5-012276532df2 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d1a5d99d-e8fb-4609-9156-795e1530efef req-4e63be73-f2f5-46b2-b9e5-012276532df2 service nova] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d1a5d99d-e8fb-4609-9156-795e1530efef req-4e63be73-f2f5-46b2-b9e5-012276532df2 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d1a5d99d-e8fb-4609-9156-795e1530efef req-4e63be73-f2f5-46b2-b9e5-012276532df2 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-d1a5d99d-e8fb-4609-9156-795e1530efef req-4e63be73-f2f5-46b2-b9e5-012276532df2 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] No waiting events found dispatching network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:47:24 user nova-compute[73029]: WARNING nova.compute.manager [req-d1a5d99d-e8fb-4609-9156-795e1530efef req-4e63be73-f2f5-46b2-b9e5-012276532df2 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received unexpected event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 for instance with vm_state building and task_state spawning.
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:47:24 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:47:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[461642ea-8b1e-42cb-8434-234767d7cfdb]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG os_brick.utils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Updating existing volume attachment record: 3b8dd1e1-c0ef-4dfe-9386-6d4b8744ce4b {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-812333ef-58d0-4fe1-a4b6-aed27c46f3dc None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-8cd9a191-241b-4580-a313-b7e876c5ea3d req-31438090-3715-44bd-8255-27590d706c93 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8cd9a191-241b-4580-a313-b7e876c5ea3d req-31438090-3715-44bd-8255-27590d706c93 service nova] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8cd9a191-241b-4580-a313-b7e876c5ea3d req-31438090-3715-44bd-8255-27590d706c93 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8cd9a191-241b-4580-a313-b7e876c5ea3d req-31438090-3715-44bd-8255-27590d706c93 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-8cd9a191-241b-4580-a313-b7e876c5ea3d req-31438090-3715-44bd-8255-27590d706c93 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] No waiting events found dispatching network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:47:26 user nova-compute[73029]: WARNING nova.compute.manager [req-8cd9a191-241b-4580-a313-b7e876c5ea3d req-31438090-3715-44bd-8255-27590d706c93 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received unexpected event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 for instance with vm_state building and task_state spawning.
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628446.1562846, 6138a253-2316-4468-b8f9-9268b1b4ded1 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:47:26 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] VM Resumed (Lifecycle Event)
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:47:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Instance spawned successfully.
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:47:26 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628446.1604931, 6138a253-2316-4468-b8f9-9268b1b4ded1 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:47:26 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] VM Started (Lifecycle Event)
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:47:26 user nova-compute[73029]: INFO nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Took 7.28 seconds to spawn the instance on the hypervisor.
Aug 10 00:47:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:47:26 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:47:26 user nova-compute[73029]: INFO nova.compute.manager [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Took 8.10 seconds to build instance.
Aug 10 00:47:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5c092f26-2bfd-4616-90b3-fbec1cae3005 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.207s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:30 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:47:30 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7601MB free_disk=25.2652587890625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Applying migration context for instance a759a046-b39b-4c7d-88ce-bf6922af5a81 as it has an incoming, in-progress migration 61f90acd-6088-4084-ac72-a1f8c83d78c1. Migration status is finished {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 10 00:47:30 user nova-compute[73029]: INFO nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating resource usage from migration 61f90acd-6088-4084-ac72-a1f8c83d78c1
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 655f9889-40ea-416f-9df2-71838819c37b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 87bdf189-555c-4bf1-85cb-b5eed3753dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Migration 61f90acd-6088-4084-ac72-a1f8c83d78c1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a759a046-b39b-4c7d-88ce-bf6922af5a81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance bda1d893-0d5b-46da-9f32-b0e2402c28aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 6138a253-2316-4468-b8f9-9268b1b4ded1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:47:30 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:47:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:47:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRuJtrPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:34 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:34 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:34 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece66d4d-b4c3-4fd4-8c4d-e2b6bf846d60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:47:34 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[788be6ce-eb6d-4e7a-9fb4-4869729348e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d] added
Aug 10 00:47:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eef8b2-af66-4945-a230-e1306a2a8fc1]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fc7bdd-0916-4151-8827-0ac19a926a6b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRuJtrPS {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRuJtrPS" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8936a59d-8782-44d3-9a2e-17abac370819]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GRuJtrPS'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec99902b-47f8-4d24-b92d-ab95b486a287]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e80a4a4-ef51-4fd7-a846-0dfd60145c6e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:47:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:47:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[12af93ca-a7bc-41e4-8ec4-6802cc6dbe5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d, portal: 172.16.0.220,3260]
Aug 10 00:47:34 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d, portal: 172.16.0.220,3260] successful.
Aug 10 00:47:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee969b8-55c2-489d-b89e-e4eaa3042248]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2628038e-0388-43e7-95cc-b2ddf1cbc42b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d (non-flash)
Aug 10 00:47:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:47:34 user nova-compute[73029]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d (non-flash)
Aug 10 00:47:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a66b4e2-e569-4b92-a896-0f0ea3e4bdc9]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:47:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRuJtrPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:47:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23563653134393032', 'path': '/dev/sde'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563653134393032', 'path': '/dev/sde'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:47:35 user nova-compute[73029]: DEBUG nova.objects.instance [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lazy-loading 'flavor' on Instance uuid 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:47:35 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:47:35 user nova-compute[73029]:   <source dev="/dev/sde"/>
Aug 10 00:47:35 user nova-compute[73029]:   <target dev="vdc" bus="virtio"/>
Aug 10 00:47:35 user nova-compute[73029]:   <serial>25197b71-48f1-46ca-a699-6153d471b41d</serial>
Aug 10 00:47:35 user nova-compute[73029]: </disk>
Aug 10 00:47:35 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:47:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:47:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:47:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:47:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] No VIF found with MAC fa:16:3e:13:83:00, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:47:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-29e8c253-a560-4e07-a2e3-ff9c36d90600 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.342s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:37 user nova-compute[73029]: INFO nova.compute.manager [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Detaching volume 25197b71-48f1-46ca-a699-6153d471b41d
Aug 10 00:47:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:37 user nova-compute[73029]: INFO nova.virt.block_device [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Attempting to driver detach volume 25197b71-48f1-46ca-a699-6153d471b41d from mountpoint /dev/vdc
Aug 10 00:47:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Attempting to detach device vdc from instance 655f9889-40ea-416f-9df2-71838819c37b from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:47:37 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:47:37 user nova-compute[73029]:   <source dev="/dev/sde"/>
Aug 10 00:47:37 user nova-compute[73029]:   <target dev="vdc" bus="virtio"/>
Aug 10 00:47:37 user nova-compute[73029]:   <serial>25197b71-48f1-46ca-a699-6153d471b41d</serial>
Aug 10 00:47:37 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 10 00:47:37 user nova-compute[73029]: </disk>
Aug 10 00:47:37 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:47:37 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Successfully detached device vdc from instance 655f9889-40ea-416f-9df2-71838819c37b from the persistent domain config.
Aug 10 00:47:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 655f9889-40ea-416f-9df2-71838819c37b from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:47:37 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:47:37 user nova-compute[73029]:   <source dev="/dev/sde"/>
Aug 10 00:47:37 user nova-compute[73029]:   <target dev="vdc" bus="virtio"/>
Aug 10 00:47:37 user nova-compute[73029]:   <serial>25197b71-48f1-46ca-a699-6153d471b41d</serial>
Aug 10 00:47:37 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 10 00:47:37 user nova-compute[73029]: </disk>
Aug 10 00:47:37 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628457.7110012, 655f9889-40ea-416f-9df2-71838819c37b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:47:37 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Successfully detached device vdc from instance 655f9889-40ea-416f-9df2-71838819c37b from the live domain config.
Aug 10 00:47:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRuJtrPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:37 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6675bfb-fa6f-4790-9b72-717d792b831b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac99500d-173e-4beb-b56a-703bddde413b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:37 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:37 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:47:37 user nova-compute[73029]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d (non-flash)
Aug 10 00:47:37 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:47:37 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:47:37 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:47:37 user nova-compute[73029]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d (non-flash)
Aug 10 00:47:37 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f07e8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d'): ({'sde'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Removing single pathed devices sde {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcae8a3-bb1f-4c3b-a1a9-ecc46f0baf64]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b094bc-b3a9-437f-8021-8abf2a5c23eb]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Flushing IO for device /dev/sde {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbd6e02-571a-473e-8774-b0c9dc9cf5b7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa1149-3adf-4e6b-bcb3-9c6fadd4133e]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] SCSI volumes sde have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0aa4e8-7a3e-4439-b90f-8ce0eba506c6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[57345471-3634-4d16-bac0-cb574f2544cf]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d, portal: 172.16.0.220,3260]
Aug 10 00:47:37 user nova-compute[73029]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d, portal: 172.16.0.220,3260] successful.
Aug 10 00:47:37 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25197b71-48f1-46ca-a699-6153d471b41d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[baae6c6b-1cf0-4fc4-b749-7549ca06fa1e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:47:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:47:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] <== disconnect_volume: return (299ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:47:38 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lazy-loading 'flavor' on Instance uuid 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:47:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d6001edb-2111-4bb4-95c8-524756d3d7e5 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.888s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 req-6adc5478-9dbe-46d6-a9af-92ec420dd136 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event volume-reimaged-e6cae31c-7aeb-4937-9ac3-38b62c30c710 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 req-6adc5478-9dbe-46d6-a9af-92ec420dd136 service nova] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 req-6adc5478-9dbe-46d6-a9af-92ec420dd136 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 req-6adc5478-9dbe-46d6-a9af-92ec420dd136 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 req-6adc5478-9dbe-46d6-a9af-92ec420dd136 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Processing event volume-reimaged-e6cae31c-7aeb-4937-9ac3-38b62c30c710 {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance event wait completed in 41 seconds for volume-reimaged {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:47:52 user nova-compute[73029]: INFO nova.virt.block_device [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Booting with volume e6cae31c-7aeb-4937-9ac3-38b62c30c710 at /dev/vda
Aug 10 00:47:52 user nova-compute[73029]: DEBUG os_brick.utils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[681a4b47-9d3d-42f4-a34e-ec453db7f5e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4590c4-98ca-492c-8fa4-175e09f4a9b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[506ce789-9611-423b-b6e7-4d6ec49fccf2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58d9969-3d7f-46aa-bb38-c8d1756a9352]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:47:52 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:47:52 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4606d411-044a-450f-8acb-96198ef02093]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG os_brick.utils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:47:52 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Updating existing volume attachment record: 49d55ef8-fb2b-4f85-8f93-8f415b672b97 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:47:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:47:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:48:01 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Creating image(s)
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Ensure instance console log exists: /opt/stack/data/nova/instances/87bdf189-555c-4bf1-85cb-b5eed3753dca/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Start _get_guest_xml network_info=[{"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '49d55ef8-fb2b-4f85-8f93-8f415b672b97', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRHeCZFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87bdf189-555c-4bf1-85cb-b5eed3753dca', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6cae31c-7aeb-4937-9ac3-38b62c30c710', 'serial': 'e6cae31c-7aeb-4937-9ac3-38b62c30c710'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:48:01 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 10 00:48:01 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87bdf189-555c-4bf1-85cb-b5eed3753dca {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRHeCZFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:48:01 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 10 00:48:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:48:01 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 10 00:48:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:48:01 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fb71d1-01f4-4d3a-a663-f8249555d82d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:48:01 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434d991-9db9-4962-b2a8-e357125cd272]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710] added
Aug 10 00:48:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a2590-f87d-4436-9e5a-60daf248fac2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.055s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8b8336-e4d8-402a-8ca9-b236920c3c94]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRHeCZFL {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRHeCZFL" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdeb10b-3275-42bc-9dba-1ec324510b4c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JRHeCZFL'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b963845-380d-48ee-94b8-9efc322387af]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec91308-74ee-4b71-99cc-e5b88bd85a52]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:48:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:48:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a35931b-127a-45a3-af99-44b6d30d854e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260]
Aug 10 00:48:02 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260] successful.
Aug 10 00:48:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[616549be-96a0-4a6d-8fc6-d1cd5ad42a19]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8a8628-1137-4504-8dbd-5d6f372a1094]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:48:02 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:48:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca0635c-ce82-4e77-803a-24e0b24e3bf1]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRHeCZFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:48:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26339313234663862', 'path': '/dev/sde'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339313234663862', 'path': '/dev/sde'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T00:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1270266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-122230355',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn6b0RvSjlr4qzfZjVXoWj2PIrxciTiPOYgKZjzkDkC1B6RxtLw3DaUNafzuQ/VYtXasTgpZXLAj7T1zQ7bM8cO35G0xt5HXDWFvm+zHBR6fzyt5SgxtU/1uYGuUgWVjA==',key_name='tempest-keypair-1957671487',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='07258fd0d1784a0584f05238888556d7',ramdisk_id='',reservation_id='r-gc00zg80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1416245590',owner_user_name='tempest-ServerActionsV293TestJSON-1416245590-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28a10069ba1b486491a647c7aaec3324',uuid=87bdf189-555c-4bf1-85cb-b5eed3753dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converting VIF {"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:48:03 user nova-compute[73029]:   <uuid>87bdf189-555c-4bf1-85cb-b5eed3753dca</uuid>
Aug 10 00:48:03 user nova-compute[73029]:   <name>instance-00000019</name>
Aug 10 00:48:03 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:48:03 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:48:03 user nova-compute[73029]:   <metadata>
Aug 10 00:48:03 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:48:03 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:48:03 user nova-compute[73029]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1270266463</nova:name>
Aug 10 00:48:03 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:48:01</nova:creationTime>
Aug 10 00:48:03 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:48:03 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:48:03 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:48:03 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:48:03 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:48:03 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:48:03 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:48:03 user nova-compute[73029]:       <nova:owner>
Aug 10 00:48:03 user nova-compute[73029]:         <nova:user uuid="28a10069ba1b486491a647c7aaec3324">tempest-ServerActionsV293TestJSON-1416245590-project-member</nova:user>
Aug 10 00:48:03 user nova-compute[73029]:         <nova:project uuid="07258fd0d1784a0584f05238888556d7">tempest-ServerActionsV293TestJSON-1416245590</nova:project>
Aug 10 00:48:03 user nova-compute[73029]:       </nova:owner>
Aug 10 00:48:03 user nova-compute[73029]:       <nova:ports>
Aug 10 00:48:03 user nova-compute[73029]:         <nova:port uuid="969e1ff4-cb79-4f35-9121-d34f9ef7849d">
Aug 10 00:48:03 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 00:48:03 user nova-compute[73029]:         </nova:port>
Aug 10 00:48:03 user nova-compute[73029]:       </nova:ports>
Aug 10 00:48:03 user nova-compute[73029]:     </nova:instance>
Aug 10 00:48:03 user nova-compute[73029]:   </metadata>
Aug 10 00:48:03 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:48:03 user nova-compute[73029]:     <system>
Aug 10 00:48:03 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:48:03 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:48:03 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:48:03 user nova-compute[73029]:       <entry name="serial">87bdf189-555c-4bf1-85cb-b5eed3753dca</entry>
Aug 10 00:48:03 user nova-compute[73029]:       <entry name="uuid">87bdf189-555c-4bf1-85cb-b5eed3753dca</entry>
Aug 10 00:48:03 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:48:03 user nova-compute[73029]:     </system>
Aug 10 00:48:03 user nova-compute[73029]:   </sysinfo>
Aug 10 00:48:03 user nova-compute[73029]:   <os>
Aug 10 00:48:03 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:48:03 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:48:03 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:48:03 user nova-compute[73029]:   </os>
Aug 10 00:48:03 user nova-compute[73029]:   <features>
Aug 10 00:48:03 user nova-compute[73029]:     <acpi/>
Aug 10 00:48:03 user nova-compute[73029]:     <apic/>
Aug 10 00:48:03 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:48:03 user nova-compute[73029]:   </features>
Aug 10 00:48:03 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:48:03 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:48:03 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:48:03 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:48:03 user nova-compute[73029]:   </clock>
Aug 10 00:48:03 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:48:03 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:48:03 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:48:03 user nova-compute[73029]:   </cpu>
Aug 10 00:48:03 user nova-compute[73029]:   <devices>
Aug 10 00:48:03 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:48:03 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:48:03 user nova-compute[73029]:       <source dev="/dev/sde"/>
Aug 10 00:48:03 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:48:03 user nova-compute[73029]:       <serial>e6cae31c-7aeb-4937-9ac3-38b62c30c710</serial>
Aug 10 00:48:03 user nova-compute[73029]:     </disk>
Aug 10 00:48:03 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:48:03 user nova-compute[73029]:       <mac address="fa:16:3e:c5:d1:85"/>
Aug 10 00:48:03 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:48:03 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:48:03 user nova-compute[73029]:       <target dev="tap969e1ff4-cb"/>
Aug 10 00:48:03 user nova-compute[73029]:     </interface>
Aug 10 00:48:03 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:48:03 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/87bdf189-555c-4bf1-85cb-b5eed3753dca/console.log" append="off"/>
Aug 10 00:48:03 user nova-compute[73029]:     </serial>
Aug 10 00:48:03 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:48:03 user nova-compute[73029]:     <video>
Aug 10 00:48:03 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:48:03 user nova-compute[73029]:     </video>
Aug 10 00:48:03 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:48:03 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:48:03 user nova-compute[73029]:     </rng>
Aug 10 00:48:03 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:48:03 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:48:03 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:48:03 user nova-compute[73029]:     </memballoon>
Aug 10 00:48:03 user nova-compute[73029]:   </devices>
Aug 10 00:48:03 user nova-compute[73029]: </domain>
Aug 10 00:48:03 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T00:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1270266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-122230355',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn6b0RvSjlr4qzfZjVXoWj2PIrxciTiPOYgKZjzkDkC1B6RxtLw3DaUNafzuQ/VYtXasTgpZXLAj7T1zQ7bM8cO35G0xt5HXDWFvm+zHBR6fzyt5SgxtU/1uYGuUgWVjA==',key_name='tempest-keypair-1957671487',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='07258fd0d1784a0584f05238888556d7',ramdisk_id='',reservation_id='r-gc00zg80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1416245590',owner_user_name='tempest-ServerActionsV293TestJSON-1416245590-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28a10069ba1b486491a647c7aaec3324',uuid=87bdf189-555c-4bf1-85cb-b5eed3753dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converting VIF {"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG os_vif [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap969e1ff4-cb, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap969e1ff4-cb, col_values=(('external_ids', {'iface-id': '969e1ff4-cb79-4f35-9121-d34f9ef7849d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:d1:85', 'vm-uuid': '87bdf189-555c-4bf1-85cb-b5eed3753dca'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:03 user nova-compute[73029]: INFO os_vif [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb')
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:48:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] No VIF found with MAC fa:16:3e:c5:d1:85, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:04 user nova-compute[73029]: DEBUG nova.compute.manager [req-33573bbc-9100-4832-92b3-321bbe00d5a4 req-dd0f9f54-0311-40ac-8ec9-be7d2d0621bb service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:48:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-33573bbc-9100-4832-92b3-321bbe00d5a4 req-dd0f9f54-0311-40ac-8ec9-be7d2d0621bb service nova] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-33573bbc-9100-4832-92b3-321bbe00d5a4 req-dd0f9f54-0311-40ac-8ec9-be7d2d0621bb service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-33573bbc-9100-4832-92b3-321bbe00d5a4 req-dd0f9f54-0311-40ac-8ec9-be7d2d0621bb service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:04 user nova-compute[73029]: DEBUG nova.compute.manager [req-33573bbc-9100-4832-92b3-321bbe00d5a4 req-dd0f9f54-0311-40ac-8ec9-be7d2d0621bb service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] No waiting events found dispatching network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:48:04 user nova-compute[73029]: WARNING nova.compute.manager [req-33573bbc-9100-4832-92b3-321bbe00d5a4 req-dd0f9f54-0311-40ac-8ec9-be7d2d0621bb service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received unexpected event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d for instance with vm_state active and task_state rebuild_spawning.
Aug 10 00:48:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Going to confirm migration 2 {{(pid=73029) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquired lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'info_cache' on Instance uuid a759a046-b39b-4c7d-88ce-bf6922af5a81 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628486.710156, 87bdf189-555c-4bf1-85cb-b5eed3753dca => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:48:06 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] VM Resumed (Lifecycle Event)
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:48:06 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance spawned successfully.
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating instance_info_cache with network_info: [{"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:06 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628486.713473, 87bdf189-555c-4bf1-85cb-b5eed3753dca => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:48:06 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] VM Started (Lifecycle Event)
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Releasing lock "refresh_cache-a759a046-b39b-4c7d-88ce-bf6922af5a81" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'migration_context' on Instance uuid a759a046-b39b-4c7d-88ce-bf6922af5a81 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:48:06 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6dcb7e2-62f9-475f-afc9-95586043037e req-8a7455ad-d9a7-4c4d-b554-f6a5047ed466 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6dcb7e2-62f9-475f-afc9-95586043037e req-8a7455ad-d9a7-4c4d-b554-f6a5047ed466 service nova] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6dcb7e2-62f9-475f-afc9-95586043037e req-8a7455ad-d9a7-4c4d-b554-f6a5047ed466 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d6dcb7e2-62f9-475f-afc9-95586043037e req-8a7455ad-d9a7-4c4d-b554-f6a5047ed466 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:06 user nova-compute[73029]: DEBUG nova.compute.manager [req-d6dcb7e2-62f9-475f-afc9-95586043037e req-8a7455ad-d9a7-4c4d-b554-f6a5047ed466 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] No waiting events found dispatching network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:48:06 user nova-compute[73029]: WARNING nova.compute.manager [req-d6dcb7e2-62f9-475f-afc9-95586043037e req-8a7455ad-d9a7-4c4d-b554-f6a5047ed466 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received unexpected event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d for instance with vm_state active and task_state rebuild_spawning.
Aug 10 00:48:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:07 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:48:07 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:48:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.382s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.291s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:07 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73029) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 10 00:48:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4aaf9b51-81b6-4ef8-baff-291bde5a68b2 tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:07 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Deleted allocation for migration 61f90acd-6088-4084-ac72-a1f8c83d78c1
Aug 10 00:48:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5ecc3c9-49b8-496e-83ed-5179fdeeb04c tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.531s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating instance_info_cache with network_info: [{"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-ee3b2f60-0756-4d77-97ac-11fa0c456c1f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:48:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:48:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:48:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:48:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:48:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:48:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:27 user nova-compute[73029]: INFO nova.compute.manager [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Detaching volume 62a9ba99-b72f-48dc-b37c-1e5e0c6d922c
Aug 10 00:48:27 user nova-compute[73029]: INFO nova.virt.block_device [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Attempting to driver detach volume 62a9ba99-b72f-48dc-b37c-1e5e0c6d922c from mountpoint /dev/vdb
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Attempting to detach device vdb from instance 655f9889-40ea-416f-9df2-71838819c37b from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:48:27 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:48:27 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:48:27 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:48:27 user nova-compute[73029]:   <serial>62a9ba99-b72f-48dc-b37c-1e5e0c6d922c</serial>
Aug 10 00:48:27 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:48:27 user nova-compute[73029]: </disk>
Aug 10 00:48:27 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:48:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Successfully detached device vdb from instance 655f9889-40ea-416f-9df2-71838819c37b from the persistent domain config.
Aug 10 00:48:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 655f9889-40ea-416f-9df2-71838819c37b from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:48:27 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:48:27 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:48:27 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:48:27 user nova-compute[73029]:   <serial>62a9ba99-b72f-48dc-b37c-1e5e0c6d922c</serial>
Aug 10 00:48:27 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:48:27 user nova-compute[73029]: </disk>
Aug 10 00:48:27 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628508.3400633, 655f9889-40ea-416f-9df2-71838819c37b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:48:28 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Successfully detached device vdb from instance 655f9889-40ea-416f-9df2-71838819c37b from the live domain config.
Aug 10 00:48:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDyxnQJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:48:28 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[277b7da5-b40d-41cb-ac63-41cb39d20e0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b92db6-9fdc-4b50-97b8-3fef8135b584]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:28 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:28 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:48:28 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:48:28 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:28 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:28 user nova-compute[73029]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c (non-flash)
Aug 10 00:48:28 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:48:28 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141bd360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c'): ({'sdd'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Removing single pathed devices sdd {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e121f07-ff4d-45d4-82c6-73429670f8d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dba8b39-43a3-4b22-b4a5-5cafe6ee37af]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Flushing IO for device /dev/sdd {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ffdcb2-7ecf-4f25-ad46-0a01ac6611fa]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1827f7-b433-4f07-80a2-b21d9b6739d1]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b0b5fa-d54f-4c4c-a626-200700b6e1ff]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b3025c-b47c-43e7-a0a4-a5189dded93c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c, portal: 172.16.0.220,3260]
Aug 10 00:48:28 user nova-compute[73029]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c, portal: 172.16.0.220,3260] successful.
Aug 10 00:48:28 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a9ba99-b72f-48dc-b37c-1e5e0c6d922c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44834aa-95c9-4541-b5fe-a5874e6fa49e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] <== disconnect_volume: return (303ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lazy-loading 'flavor' on Instance uuid 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-74d59750-c619-4bb1-8a4e-d6cefe37945e tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.373s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:30 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:48:30 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7342MB free_disk=25.22602081298828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 655f9889-40ea-416f-9df2-71838819c37b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 87bdf189-555c-4bf1-85cb-b5eed3753dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a759a046-b39b-4c7d-88ce-bf6922af5a81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance bda1d893-0d5b-46da-9f32-b0e2402c28aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 6138a253-2316-4468-b8f9-9268b1b4ded1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:48:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:31 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:48:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:48:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:48:39 user nova-compute[73029]: INFO nova.compute.claims [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Claim successful on node user
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.network.neutron [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:48:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.policy [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a4fb6b058c64442b1688a3962849322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54d7ee7b2c741e2bbc4a1fb4a2cc042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:48:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Creating image(s)
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.151s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk 1073741824" returned: 0 in 0.264s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.421s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.166s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG nova.network.neutron [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Successfully created port: 5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Cannot resize image /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG nova.objects.instance [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'migration_context' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Ensure instance console log exists: /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.network.neutron [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Successfully updated port: 5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquired lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.network.neutron [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-a1ab4c9e-2cb9-40ec-91fc-114502d06b47 req-94665cf1-0279-477b-b4c9-597fa87650a4 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-changed-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-a1ab4c9e-2cb9-40ec-91fc-114502d06b47 req-94665cf1-0279-477b-b4c9-597fa87650a4 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Refreshing instance network info cache due to event network-changed-5b34c38b-4298-4f65-807d-1ca3bc317978. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a1ab4c9e-2cb9-40ec-91fc-114502d06b47 req-94665cf1-0279-477b-b4c9-597fa87650a4 service nova] Acquiring lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.network.neutron [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.network.neutron [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating instance_info_cache with network_info: [{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Releasing lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Instance network_info: |[{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a1ab4c9e-2cb9-40ec-91fc-114502d06b47 req-94665cf1-0279-477b-b4c9-597fa87650a4 service nova] Acquired lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.network.neutron [req-a1ab4c9e-2cb9-40ec-91fc-114502d06b47 req-94665cf1-0279-477b-b4c9-597fa87650a4 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Refreshing network info cache for port 5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Start _get_guest_xml network_info=[{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:48:41 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:48:41 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-398395019',display_name='tempest-ServerRescueNegativeTestJSON-server-398395019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-398395019',id=28,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7gu9lAx8RZscHpV51sLlq+jmbUmX3cj6dU9fSYJOfds8jWOFd+VGlw8A3s5DhjojkrDtcsYc3LmedBHmlwJ8c4jMklrj3BDyOgOoPfuiptIqbnAnTxkAkejQV+KuITlg==',key_name='tempest-keypair-2057180871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-m8028215',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a4fb6b058c64442b1688a3962849322',uuid=03d2b73d-de9a-4669-8d31-f3d38063faac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ee:58,bridge_name='br-int',has_traffic_filtering=True,id=5b34c38b-4298-4f65-807d-1ca3bc317978,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b34c38b-42') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:48:41 user nova-compute[73029]: DEBUG nova.objects.instance [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'pci_devices' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:48:42 user nova-compute[73029]:   <uuid>03d2b73d-de9a-4669-8d31-f3d38063faac</uuid>
Aug 10 00:48:42 user nova-compute[73029]:   <name>instance-0000001c</name>
Aug 10 00:48:42 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:48:42 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:48:42 user nova-compute[73029]:   <metadata>
Aug 10 00:48:42 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:48:42 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:48:42 user nova-compute[73029]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-398395019</nova:name>
Aug 10 00:48:42 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:48:41</nova:creationTime>
Aug 10 00:48:42 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:48:42 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:48:42 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:48:42 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:48:42 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:48:42 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:48:42 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:48:42 user nova-compute[73029]:       <nova:owner>
Aug 10 00:48:42 user nova-compute[73029]:         <nova:user uuid="4a4fb6b058c64442b1688a3962849322">tempest-ServerRescueNegativeTestJSON-1160585559-project-member</nova:user>
Aug 10 00:48:42 user nova-compute[73029]:         <nova:project uuid="e54d7ee7b2c741e2bbc4a1fb4a2cc042">tempest-ServerRescueNegativeTestJSON-1160585559</nova:project>
Aug 10 00:48:42 user nova-compute[73029]:       </nova:owner>
Aug 10 00:48:42 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:48:42 user nova-compute[73029]:       <nova:ports>
Aug 10 00:48:42 user nova-compute[73029]:         <nova:port uuid="5b34c38b-4298-4f65-807d-1ca3bc317978">
Aug 10 00:48:42 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 10 00:48:42 user nova-compute[73029]:         </nova:port>
Aug 10 00:48:42 user nova-compute[73029]:       </nova:ports>
Aug 10 00:48:42 user nova-compute[73029]:     </nova:instance>
Aug 10 00:48:42 user nova-compute[73029]:   </metadata>
Aug 10 00:48:42 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:48:42 user nova-compute[73029]:     <system>
Aug 10 00:48:42 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:48:42 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:48:42 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:48:42 user nova-compute[73029]:       <entry name="serial">03d2b73d-de9a-4669-8d31-f3d38063faac</entry>
Aug 10 00:48:42 user nova-compute[73029]:       <entry name="uuid">03d2b73d-de9a-4669-8d31-f3d38063faac</entry>
Aug 10 00:48:42 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:48:42 user nova-compute[73029]:     </system>
Aug 10 00:48:42 user nova-compute[73029]:   </sysinfo>
Aug 10 00:48:42 user nova-compute[73029]:   <os>
Aug 10 00:48:42 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:48:42 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:48:42 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:48:42 user nova-compute[73029]:   </os>
Aug 10 00:48:42 user nova-compute[73029]:   <features>
Aug 10 00:48:42 user nova-compute[73029]:     <acpi/>
Aug 10 00:48:42 user nova-compute[73029]:     <apic/>
Aug 10 00:48:42 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:48:42 user nova-compute[73029]:   </features>
Aug 10 00:48:42 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:48:42 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:48:42 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:48:42 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:48:42 user nova-compute[73029]:   </clock>
Aug 10 00:48:42 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:48:42 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:48:42 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:48:42 user nova-compute[73029]:   </cpu>
Aug 10 00:48:42 user nova-compute[73029]:   <devices>
Aug 10 00:48:42 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:48:42 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:48:42 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk"/>
Aug 10 00:48:42 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:48:42 user nova-compute[73029]:     </disk>
Aug 10 00:48:42 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:48:42 user nova-compute[73029]:       <mac address="fa:16:3e:e9:ee:58"/>
Aug 10 00:48:42 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:48:42 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:48:42 user nova-compute[73029]:       <target dev="tap5b34c38b-42"/>
Aug 10 00:48:42 user nova-compute[73029]:     </interface>
Aug 10 00:48:42 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:48:42 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/console.log" append="off"/>
Aug 10 00:48:42 user nova-compute[73029]:     </serial>
Aug 10 00:48:42 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:48:42 user nova-compute[73029]:     <video>
Aug 10 00:48:42 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:48:42 user nova-compute[73029]:     </video>
Aug 10 00:48:42 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:48:42 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:48:42 user nova-compute[73029]:     </rng>
Aug 10 00:48:42 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:48:42 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:48:42 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:48:42 user nova-compute[73029]:     </memballoon>
Aug 10 00:48:42 user nova-compute[73029]:   </devices>
Aug 10 00:48:42 user nova-compute[73029]: </domain>
Aug 10 00:48:42 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-398395019',display_name='tempest-ServerRescueNegativeTestJSON-server-398395019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-398395019',id=28,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7gu9lAx8RZscHpV51sLlq+jmbUmX3cj6dU9fSYJOfds8jWOFd+VGlw8A3s5DhjojkrDtcsYc3LmedBHmlwJ8c4jMklrj3BDyOgOoPfuiptIqbnAnTxkAkejQV+KuITlg==',key_name='tempest-keypair-2057180871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-m8028215',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a4fb6b058c64442b1688a3962849322',uuid=03d2b73d-de9a-4669-8d31-f3d38063faac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ee:58,bridge_name='br-int',has_traffic_filtering=True,id=5b34c38b-4298-4f65-807d-1ca3bc317978,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b34c38b-42') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG os_vif [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ee:58,bridge_name='br-int',has_traffic_filtering=True,id=5b34c38b-4298-4f65-807d-1ca3bc317978,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b34c38b-42') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b34c38b-42, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b34c38b-42, col_values=(('external_ids', {'iface-id': '5b34c38b-4298-4f65-807d-1ca3bc317978', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:ee:58', 'vm-uuid': '03d2b73d-de9a-4669-8d31-f3d38063faac'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:42 user nova-compute[73029]: INFO os_vif [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ee:58,bridge_name='br-int',has_traffic_filtering=True,id=5b34c38b-4298-4f65-807d-1ca3bc317978,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b34c38b-42')
Aug 10 00:48:42 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No VIF found with MAC fa:16:3e:e9:ee:58, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG nova.network.neutron [req-a1ab4c9e-2cb9-40ec-91fc-114502d06b47 req-94665cf1-0279-477b-b4c9-597fa87650a4 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updated VIF entry in instance network info cache for port 5b34c38b-4298-4f65-807d-1ca3bc317978. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG nova.network.neutron [req-a1ab4c9e-2cb9-40ec-91fc-114502d06b47 req-94665cf1-0279-477b-b4c9-597fa87650a4 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating instance_info_cache with network_info: [{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:48:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a1ab4c9e-2cb9-40ec-91fc-114502d06b47 req-94665cf1-0279-477b-b4c9-597fa87650a4 service nova] Releasing lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:48:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-add0d1c6-e110-4050-9e76-85ac5e0abfaa req-4ba305ec-80de-45cf-8b52-fc57cd91c714 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:48:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-add0d1c6-e110-4050-9e76-85ac5e0abfaa req-4ba305ec-80de-45cf-8b52-fc57cd91c714 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-add0d1c6-e110-4050-9e76-85ac5e0abfaa req-4ba305ec-80de-45cf-8b52-fc57cd91c714 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-add0d1c6-e110-4050-9e76-85ac5e0abfaa req-4ba305ec-80de-45cf-8b52-fc57cd91c714 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-add0d1c6-e110-4050-9e76-85ac5e0abfaa req-4ba305ec-80de-45cf-8b52-fc57cd91c714 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:48:43 user nova-compute[73029]: WARNING nova.compute.manager [req-add0d1c6-e110-4050-9e76-85ac5e0abfaa req-4ba305ec-80de-45cf-8b52-fc57cd91c714 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state building and task_state spawning.
Aug 10 00:48:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-5c6538b0-c736-48ea-a431-42fdf5e72529 req-a164da35-2b7a-48ef-91b9-e1863cc5d815 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received event network-changed-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:48:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-5c6538b0-c736-48ea-a431-42fdf5e72529 req-a164da35-2b7a-48ef-91b9-e1863cc5d815 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Refreshing instance network info cache due to event network-changed-a6681947-5c76-41a4-9552-65c920662ec7. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:48:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5c6538b0-c736-48ea-a431-42fdf5e72529 req-a164da35-2b7a-48ef-91b9-e1863cc5d815 service nova] Acquiring lock "refresh_cache-bda1d893-0d5b-46da-9f32-b0e2402c28aa" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:48:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5c6538b0-c736-48ea-a431-42fdf5e72529 req-a164da35-2b7a-48ef-91b9-e1863cc5d815 service nova] Acquired lock "refresh_cache-bda1d893-0d5b-46da-9f32-b0e2402c28aa" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:48:44 user nova-compute[73029]: DEBUG nova.network.neutron [req-5c6538b0-c736-48ea-a431-42fdf5e72529 req-a164da35-2b7a-48ef-91b9-e1863cc5d815 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Refreshing network info cache for port a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:48:44 user nova-compute[73029]: DEBUG nova.network.neutron [req-5c6538b0-c736-48ea-a431-42fdf5e72529 req-a164da35-2b7a-48ef-91b9-e1863cc5d815 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Updated VIF entry in instance network info cache for port a6681947-5c76-41a4-9552-65c920662ec7. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:48:44 user nova-compute[73029]: DEBUG nova.network.neutron [req-5c6538b0-c736-48ea-a431-42fdf5e72529 req-a164da35-2b7a-48ef-91b9-e1863cc5d815 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Updating instance_info_cache with network_info: [{"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:48:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5c6538b0-c736-48ea-a431-42fdf5e72529 req-a164da35-2b7a-48ef-91b9-e1863cc5d815 service nova] Releasing lock "refresh_cache-bda1d893-0d5b-46da-9f32-b0e2402c28aa" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628525.696037, 03d2b73d-de9a-4669-8d31-f3d38063faac => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:48:45 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] VM Resumed (Lifecycle Event)
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:48:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Instance spawned successfully.
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:48:45 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628525.6978514, 03d2b73d-de9a-4669-8d31-f3d38063faac => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:48:45 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] VM Started (Lifecycle Event)
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-fc94f944-4636-42d7-8a40-3d9bbfa48aab req-1844b576-57d9-4654-8521-e7a149ccfffa service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fc94f944-4636-42d7-8a40-3d9bbfa48aab req-1844b576-57d9-4654-8521-e7a149ccfffa service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fc94f944-4636-42d7-8a40-3d9bbfa48aab req-1844b576-57d9-4654-8521-e7a149ccfffa service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fc94f944-4636-42d7-8a40-3d9bbfa48aab req-1844b576-57d9-4654-8521-e7a149ccfffa service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-fc94f944-4636-42d7-8a40-3d9bbfa48aab req-1844b576-57d9-4654-8521-e7a149ccfffa service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:48:45 user nova-compute[73029]: WARNING nova.compute.manager [req-fc94f944-4636-42d7-8a40-3d9bbfa48aab req-1844b576-57d9-4654-8521-e7a149ccfffa service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state building and task_state spawning.
Aug 10 00:48:45 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:48:45 user nova-compute[73029]: INFO nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 10 00:48:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:48:45 user nova-compute[73029]: INFO nova.compute.manager [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Took 7.01 seconds to build instance.
Aug 10 00:48:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-19daba80-e57b-4e27-8f9b-72eeb1b71994 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.120s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:48 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'flavor' on Instance uuid bda1d893-0d5b-46da-9f32-b0e2402c28aa {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:48:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:48:49 user nova-compute[73029]: INFO nova.compute.manager [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Attaching volume 64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 to /dev/vdb
Aug 10 00:48:49 user nova-compute[73029]: DEBUG os_brick.utils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[494273d1-3359-434d-ba28-021eda39334e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a00d0ae-d975-4eda-8cc3-f39fd47aa1c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[73431abd-4172-4241-92b8-45e317727fd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d46dfe-e6c1-430d-ae51-dd279f4c553f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:48:49 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:48:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a3742d-7ff6-47e4-8d54-eb4510aa5ae2]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG os_brick.utils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:48:49 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Updating existing volume attachment record: 11ddae98-7e3a-48e8-a0a3-e62afc5c6b4e {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:48:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwMntPoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:48:58 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:48:58 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:48:58 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8b1e83-338b-4b5d-956a-b09c14b47374]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:48:58 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[05526431-c875-4c25-b9e2-e1830a2598f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7] added
Aug 10 00:48:58 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40af1b6-3869-41be-b600-9f5a12001ce1]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d0b011-2bba-42d7-a972-64657ffa8db7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwMntPoJ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwMntPoJ" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22512f5-2310-49d1-a651-12636b858058]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwMntPoJ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac6202e-8c79-48a6-b251-49e6db8b3a02]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86fcaef-08ea-44f8-93eb-b21d7d3e8f14]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdfb548-37fe-4277-9ad9-86ebf8d4a84b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7, portal: 172.16.0.220,3260]
Aug 10 00:48:58 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7, portal: 172.16.0.220,3260] successful.
Aug 10 00:48:58 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e432e49d-5084-44d9-bb4c-f8b36287e687]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9ff51c-38bd-4fe0-89be-fd1704f72bff]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 (non-flash)
Aug 10 00:48:58 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1e8921-8cdc-4a3a-86b6-b68e176cb2f9]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:48:58 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwMntPoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:48:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:48:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23231363363326233', 'path': '/dev/sdd'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:48:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231363363326233', 'path': '/dev/sdd'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:48:59 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'flavor' on Instance uuid bda1d893-0d5b-46da-9f32-b0e2402c28aa {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:48:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:48:59 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:48:59 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:48:59 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:48:59 user nova-compute[73029]:   <serial>64fe6cc8-1b43-4eb6-834d-b1940d33f7b7</serial>
Aug 10 00:48:59 user nova-compute[73029]: </disk>
Aug 10 00:48:59 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] No VIF found with MAC fa:16:3e:05:49:59, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5f208e23-388a-4dd0-b540-18d3ab404fda tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.412s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:01 user nova-compute[73029]: INFO nova.compute.manager [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Detaching volume 64fe6cc8-1b43-4eb6-834d-b1940d33f7b7
Aug 10 00:49:01 user nova-compute[73029]: INFO nova.virt.block_device [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Attempting to driver detach volume 64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 from mountpoint /dev/vdb
Aug 10 00:49:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Attempting to detach device vdb from instance bda1d893-0d5b-46da-9f32-b0e2402c28aa from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:49:01 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:49:01 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:49:01 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:49:01 user nova-compute[73029]:   <serial>64fe6cc8-1b43-4eb6-834d-b1940d33f7b7</serial>
Aug 10 00:49:01 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:49:01 user nova-compute[73029]: </disk>
Aug 10 00:49:01 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:49:01 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully detached device vdb from instance bda1d893-0d5b-46da-9f32-b0e2402c28aa from the persistent domain config.
Aug 10 00:49:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bda1d893-0d5b-46da-9f32-b0e2402c28aa from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:49:01 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:49:01 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:49:01 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:49:01 user nova-compute[73029]:   <serial>64fe6cc8-1b43-4eb6-834d-b1940d33f7b7</serial>
Aug 10 00:49:01 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:49:01 user nova-compute[73029]: </disk>
Aug 10 00:49:01 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628541.946961, bda1d893-0d5b-46da-9f32-b0e2402c28aa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bda1d893-0d5b-46da-9f32-b0e2402c28aa {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:49:01 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully detached device vdb from instance bda1d893-0d5b-46da-9f32-b0e2402c28aa from the live domain config.
Aug 10 00:49:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwMntPoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:49:01 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:49:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b07ffa-7278-48d7-9dea-01ee25c58bae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[de138c25-567a-45c9-ae8c-68b6ff023495]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:02 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:02 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:49:02 user nova-compute[73029]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 (non-flash)
Aug 10 00:49:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:02 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:02 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:49:02 user nova-compute[73029]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 (non-flash)
Aug 10 00:49:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751c0df6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7'): ({'sdd'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Removing single pathed devices sdd {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae54bfdd-629d-425c-b659-8a278aabfcb6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed061ded-6bf1-479a-9674-5d109e213f38]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Flushing IO for device /dev/sdd {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1675f145-33cf-45fc-b02c-a1ca37b80628]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[099619ff-0f68-4b65-95c4-d96322ac1976]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[342c88b8-07df-43ce-b3e5-cc902f567ac9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[97234627-8d53-42b4-90cf-995719359733]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7, portal: 172.16.0.220,3260]
Aug 10 00:49:02 user nova-compute[73029]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7, portal: 172.16.0.220,3260] successful.
Aug 10 00:49:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe6cc8-1b43-4eb6-834d-b1940d33f7b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18e0157-2278-4ced-b2e5-b2759d05562a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] <== disconnect_volume: return (287ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:02 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'flavor' on Instance uuid bda1d893-0d5b-46da-9f32-b0e2402c28aa {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:49:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5ddc9be0-c7f5-46dc-aa1f-dc0407a7f084 tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG nova.objects.instance [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'flavor' on Instance uuid 6138a253-2316-4468-b8f9-9268b1b4ded1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:12 user nova-compute[73029]: INFO nova.compute.manager [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Attaching volume c3b92cb4-60ee-4539-a20c-9911656cd685 to /dev/vdb
Aug 10 00:49:12 user nova-compute[73029]: DEBUG os_brick.utils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff59dfd-96c4-4b0c-ba36-8ebd83cbf172]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b3951f-fffc-4475-a164-09ad53a949cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb20e33-728d-4d2b-af60-81bb19a78f74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e583065-8fd3-490a-9df8-6814f4fe887c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:49:12 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:49:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[993660fd-61af-4087-a4ea-2e828ce935b2]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG os_brick.utils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:49:12 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating existing volume attachment record: a957f966-1053-4cff-9528-100704d06e07 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:49:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:18 user nova-compute[73029]: INFO nova.compute.manager [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Terminating instance
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-1cd95cfb-5c49-4521-899c-49db1af60440 req-4962d54d-7f1b-4a75-94b4-ff4baf22407c service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received event network-vif-unplugged-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1cd95cfb-5c49-4521-899c-49db1af60440 req-4962d54d-7f1b-4a75-94b4-ff4baf22407c service nova] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1cd95cfb-5c49-4521-899c-49db1af60440 req-4962d54d-7f1b-4a75-94b4-ff4baf22407c service nova] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1cd95cfb-5c49-4521-899c-49db1af60440 req-4962d54d-7f1b-4a75-94b4-ff4baf22407c service nova] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-1cd95cfb-5c49-4521-899c-49db1af60440 req-4962d54d-7f1b-4a75-94b4-ff4baf22407c service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] No waiting events found dispatching network-vif-unplugged-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-1cd95cfb-5c49-4521-899c-49db1af60440 req-4962d54d-7f1b-4a75-94b4-ff4baf22407c service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received event network-vif-unplugged-4f8428d8-a469-452c-8218-cc53ca757d7b for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:49:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Instance destroyed successfully.
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.objects.instance [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lazy-loading 'resources' on Instance uuid 655f9889-40ea-416f-9df2-71838819c37b {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-89052549',display_name='tempest-TestServerVolumeAttachmentScenario-server-89052549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-89052549',id=24,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxqIFf9zpniq+PHxc3zzdDiI95WW55vSdGSLEQpOjjMYumSAlwY32RS4yevMGaQ/SpaGP0pZ+boEPVHa0ldwVqTU8lVX+c8/GFz6AZ4k34zMFlLlrneVdUavDQheF1mlQ==',key_name='tempest-keypair-579326169',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:45:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2885b7b1a88442a38a8c9a69a9234bff',ramdisk_id='',reservation_id='r-2njcbegw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-954433369',owner_user_name='tempest-TestServerVolumeAttachmentScenario-954433369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d53b55b655a471aa70b5a0a58d43300',uuid=655f9889-40ea-416f-9df2-71838819c37b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Converting VIF {"id": "4f8428d8-a469-452c-8218-cc53ca757d7b", "address": "fa:16:3e:13:83:00", "network": {"id": "567e3543-925a-4428-894f-5c2999e4c93e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1852704697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2885b7b1a88442a38a8c9a69a9234bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8428d8-a4", "ovs_interfaceid": "4f8428d8-a469-452c-8218-cc53ca757d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:83:00,bridge_name='br-int',has_traffic_filtering=True,id=4f8428d8-a469-452c-8218-cc53ca757d7b,network=Network(567e3543-925a-4428-894f-5c2999e4c93e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8428d8-a4') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG os_vif [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:83:00,bridge_name='br-int',has_traffic_filtering=True,id=4f8428d8-a469-452c-8218-cc53ca757d7b,network=Network(567e3543-925a-4428-894f-5c2999e4c93e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8428d8-a4') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f8428d8-a4, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:49:18 user nova-compute[73029]: INFO os_vif [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:83:00,bridge_name='br-int',has_traffic_filtering=True,id=4f8428d8-a469-452c-8218-cc53ca757d7b,network=Network(567e3543-925a-4428-894f-5c2999e4c93e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8428d8-a4')
Aug 10 00:49:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Deleting instance files /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b_del
Aug 10 00:49:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Deletion of /opt/stack/data/nova/instances/655f9889-40ea-416f-9df2-71838819c37b_del complete
Aug 10 00:49:18 user nova-compute[73029]: INFO nova.compute.manager [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 10 00:49:18 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:49:18 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 655f9889-40ea-416f-9df2-71838819c37b] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:49:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:19 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:49:19 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Took 0.75 seconds to deallocate network for instance.
Aug 10 00:49:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:20 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:49:20 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:49:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:20 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Deleted allocations for instance 655f9889-40ea-416f-9df2-71838819c37b
Aug 10 00:49:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7490dcba-1095-4ba1-8bbe-f4aa0a85cdd0 tempest-TestServerVolumeAttachmentScenario-954433369 tempest-TestServerVolumeAttachmentScenario-954433369-project-member] Lock "655f9889-40ea-416f-9df2-71838819c37b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-5c0df8cd-c44c-460c-b908-2e221ff80334 req-4bc0684f-6d99-4629-836c-8ee663faebad service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received event network-vif-plugged-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5c0df8cd-c44c-460c-b908-2e221ff80334 req-4bc0684f-6d99-4629-836c-8ee663faebad service nova] Acquiring lock "655f9889-40ea-416f-9df2-71838819c37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5c0df8cd-c44c-460c-b908-2e221ff80334 req-4bc0684f-6d99-4629-836c-8ee663faebad service nova] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5c0df8cd-c44c-460c-b908-2e221ff80334 req-4bc0684f-6d99-4629-836c-8ee663faebad service nova] Lock "655f9889-40ea-416f-9df2-71838819c37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-5c0df8cd-c44c-460c-b908-2e221ff80334 req-4bc0684f-6d99-4629-836c-8ee663faebad service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] No waiting events found dispatching network-vif-plugged-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:20 user nova-compute[73029]: WARNING nova.compute.manager [req-5c0df8cd-c44c-460c-b908-2e221ff80334 req-4bc0684f-6d99-4629-836c-8ee663faebad service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received unexpected event network-vif-plugged-4f8428d8-a469-452c-8218-cc53ca757d7b for instance with vm_state deleted and task_state None.
Aug 10 00:49:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-5c0df8cd-c44c-460c-b908-2e221ff80334 req-4bc0684f-6d99-4629-836c-8ee663faebad service nova] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Received event network-vif-deleted-4f8428d8-a469-452c-8218-cc53ca757d7b {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyhQzGKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:49:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:49:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:49:21 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a5ae4-48a5-4a97-9bbe-c6b25323acd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:49:21 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b4e968-c8fa-4947-9387-451bbf8ddc98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685] added
Aug 10 00:49:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c3c80c-9b33-46cb-882a-accc7a238892]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[77856e3e-6363-4ca9-a6db-4cde8bbcb864]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyhQzGKF {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyhQzGKF" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8849415c-81b8-4461-901d-9f8fe183204a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LyhQzGKF'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d945495-2987-4f1b-9002-eb4d14bc7918]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df44739-be6a-4cd6-a334-5304529bf44b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updating instance_info_cache with network_info: [{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82e1060-61f0-45c1-81b2-aaa132862e4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685, portal: 172.16.0.220,3260]
Aug 10 00:49:21 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685, portal: 172.16.0.220,3260] successful.
Aug 10 00:49:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d62e090-82c1-4fc2-968e-c7e2aa5b251d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0b10e7-c5a2-4b21-869d-d60994864e78]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:49:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bd8a3a-bb73-4863-bf80-783d98d6bd78]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:49:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyhQzGKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:49:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:49:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23334613731663035', 'path': '/dev/sdd'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:49:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334613731663035', 'path': '/dev/sdd'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:49:22 user nova-compute[73029]: DEBUG nova.objects.instance [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'flavor' on Instance uuid 6138a253-2316-4468-b8f9-9268b1b4ded1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:49:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:49:22 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:49:22 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:49:22 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:49:22 user nova-compute[73029]:   <serial>c3b92cb4-60ee-4539-a20c-9911656cd685</serial>
Aug 10 00:49:22 user nova-compute[73029]: </disk>
Aug 10 00:49:22 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:49:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:49:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:49:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] No VIF found with MAC fa:16:3e:f9:e9:33, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:49:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1a20292a-8453-41cd-b163-84a89fd43663 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.759s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-c4a85f4a-3b7c-415b-9fa2-6b9346adba41 req-a39d5dfa-8c6f-4478-bb87-68ef88d3ce27 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-c4a85f4a-3b7c-415b-9fa2-6b9346adba41 req-a39d5dfa-8c6f-4478-bb87-68ef88d3ce27 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing instance network info cache due to event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c4a85f4a-3b7c-415b-9fa2-6b9346adba41 req-a39d5dfa-8c6f-4478-bb87-68ef88d3ce27 service nova] Acquiring lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c4a85f4a-3b7c-415b-9fa2-6b9346adba41 req-a39d5dfa-8c6f-4478-bb87-68ef88d3ce27 service nova] Acquired lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-c4a85f4a-3b7c-415b-9fa2-6b9346adba41 req-a39d5dfa-8c6f-4478-bb87-68ef88d3ce27 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing network info cache for port ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-c4a85f4a-3b7c-415b-9fa2-6b9346adba41 req-a39d5dfa-8c6f-4478-bb87-68ef88d3ce27 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updated VIF entry in instance network info cache for port ed2decd6-a50d-42f6-9fdf-c08b0e87db91. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-c4a85f4a-3b7c-415b-9fa2-6b9346adba41 req-a39d5dfa-8c6f-4478-bb87-68ef88d3ce27 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [{"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:49:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c4a85f4a-3b7c-415b-9fa2-6b9346adba41 req-a39d5dfa-8c6f-4478-bb87-68ef88d3ce27 service nova] Releasing lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:49:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-c782b998-4858-44bc-ae90-c1ba5b057097 req-b175b579-5d63-40fd-979f-4ecf86c89491 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG nova.compute.manager [req-c782b998-4858-44bc-ae90-c1ba5b057097 req-b175b579-5d63-40fd-979f-4ecf86c89491 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing instance network info cache due to event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c782b998-4858-44bc-ae90-c1ba5b057097 req-b175b579-5d63-40fd-979f-4ecf86c89491 service nova] Acquiring lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c782b998-4858-44bc-ae90-c1ba5b057097 req-b175b579-5d63-40fd-979f-4ecf86c89491 service nova] Acquired lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG nova.network.neutron [req-c782b998-4858-44bc-ae90-c1ba5b057097 req-b175b579-5d63-40fd-979f-4ecf86c89491 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing network info cache for port ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:28 user nova-compute[73029]: INFO nova.compute.manager [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Rebooting instance
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG nova.network.neutron [req-c782b998-4858-44bc-ae90-c1ba5b057097 req-b175b579-5d63-40fd-979f-4ecf86c89491 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updated VIF entry in instance network info cache for port ed2decd6-a50d-42f6-9fdf-c08b0e87db91. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG nova.network.neutron [req-c782b998-4858-44bc-ae90-c1ba5b057097 req-b175b579-5d63-40fd-979f-4ecf86c89491 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [{"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c782b998-4858-44bc-ae90-c1ba5b057097 req-b175b579-5d63-40fd-979f-4ecf86c89491 service nova] Releasing lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquired lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG nova.network.neutron [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG nova.network.neutron [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [{"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Releasing lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG nova.compute.manager [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:49:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:49:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7464MB free_disk=25.222145080566406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 87bdf189-555c-4bf1-85cb-b5eed3753dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a759a046-b39b-4c7d-88ce-bf6922af5a81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance bda1d893-0d5b-46da-9f32-b0e2402c28aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 6138a253-2316-4468-b8f9-9268b1b4ded1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 03d2b73d-de9a-4669-8d31-f3d38063faac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-7e139c39-8227-440d-8ad2-a61886faf33c req-e7adaae1-a1cf-4277-b333-083f90cd9517 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-unplugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7e139c39-8227-440d-8ad2-a61886faf33c req-e7adaae1-a1cf-4277-b333-083f90cd9517 service nova] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7e139c39-8227-440d-8ad2-a61886faf33c req-e7adaae1-a1cf-4277-b333-083f90cd9517 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7e139c39-8227-440d-8ad2-a61886faf33c req-e7adaae1-a1cf-4277-b333-083f90cd9517 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-7e139c39-8227-440d-8ad2-a61886faf33c req-e7adaae1-a1cf-4277-b333-083f90cd9517 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] No waiting events found dispatching network-vif-unplugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:31 user nova-compute[73029]: WARNING nova.compute.manager [req-7e139c39-8227-440d-8ad2-a61886faf33c req-e7adaae1-a1cf-4277-b333-083f90cd9517 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received unexpected event network-vif-unplugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 for instance with vm_state active and task_state reboot_started.
Aug 10 00:49:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Instance shutdown successfully.
Aug 10 00:49:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:49:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] No waiting events found dispatching network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:33 user nova-compute[73029]: WARNING nova.compute.manager [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received unexpected event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 for instance with vm_state active and task_state reboot_started.
Aug 10 00:49:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] No waiting events found dispatching network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:33 user nova-compute[73029]: WARNING nova.compute.manager [req-613ceb90-c39a-4c83-b2a4-32073548aeb7 req-befcb06b-79a9-4d30-b33d-ee3eae775fa9 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received unexpected event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 for instance with vm_state active and task_state reboot_started.
Aug 10 00:49:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628558.897432, 655f9889-40ea-416f-9df2-71838819c37b => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:49:33 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 655f9889-40ea-416f-9df2-71838819c37b] VM Stopped (Lifecycle Event)
Aug 10 00:49:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-33ec0b05-5d44-493d-a1e4-04ce3c1c36b4 None None] [instance: 655f9889-40ea-416f-9df2-71838819c37b] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:49:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 6138a253-2316-4468-b8f9-9268b1b4ded1 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628575.4459126, 6138a253-2316-4468-b8f9-9268b1b4ded1 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:49:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] VM Resumed (Lifecycle Event)
Aug 10 00:49:35 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Instance running successfully.
Aug 10 00:49:35 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Instance soft rebooted successfully.
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:49:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628575.4480002, 6138a253-2316-4468-b8f9-9268b1b4ded1 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:49:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] VM Started (Lifecycle Event)
Aug 10 00:49:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-642db6f2-fb3a-4bef-9632-63578a89cfad tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.509s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-f43dcd07-2edf-4d20-ad83-60c377edfdc2 req-57d677fd-0760-4cce-b62d-d86ba10fef29 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f43dcd07-2edf-4d20-ad83-60c377edfdc2 req-57d677fd-0760-4cce-b62d-d86ba10fef29 service nova] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f43dcd07-2edf-4d20-ad83-60c377edfdc2 req-57d677fd-0760-4cce-b62d-d86ba10fef29 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f43dcd07-2edf-4d20-ad83-60c377edfdc2 req-57d677fd-0760-4cce-b62d-d86ba10fef29 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-f43dcd07-2edf-4d20-ad83-60c377edfdc2 req-57d677fd-0760-4cce-b62d-d86ba10fef29 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] No waiting events found dispatching network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:35 user nova-compute[73029]: WARNING nova.compute.manager [req-f43dcd07-2edf-4d20-ad83-60c377edfdc2 req-57d677fd-0760-4cce-b62d-d86ba10fef29 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received unexpected event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 for instance with vm_state active and task_state None.
Aug 10 00:49:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:50 user nova-compute[73029]: INFO nova.compute.manager [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Terminating instance
Aug 10 00:49:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-55758ebb-a97f-4fbc-84a8-9729d5676482 req-34bfdd4d-9dd3-4dce-9b3d-15a8afce0205 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-unplugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-55758ebb-a97f-4fbc-84a8-9729d5676482 req-34bfdd4d-9dd3-4dce-9b3d-15a8afce0205 service nova] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-55758ebb-a97f-4fbc-84a8-9729d5676482 req-34bfdd4d-9dd3-4dce-9b3d-15a8afce0205 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-55758ebb-a97f-4fbc-84a8-9729d5676482 req-34bfdd4d-9dd3-4dce-9b3d-15a8afce0205 service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-55758ebb-a97f-4fbc-84a8-9729d5676482 req-34bfdd4d-9dd3-4dce-9b3d-15a8afce0205 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] No waiting events found dispatching network-vif-unplugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-55758ebb-a97f-4fbc-84a8-9729d5676482 req-34bfdd4d-9dd3-4dce-9b3d-15a8afce0205 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-unplugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:49:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Instance destroyed successfully.
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.objects.instance [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lazy-loading 'resources' on Instance uuid 87bdf189-555c-4bf1-85cb-b5eed3753dca {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T00:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1270266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-122230355',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn6b0RvSjlr4qzfZjVXoWj2PIrxciTiPOYgKZjzkDkC1B6RxtLw3DaUNafzuQ/VYtXasTgpZXLAj7T1zQ7bM8cO35G0xt5HXDWFvm+zHBR6fzyt5SgxtU/1uYGuUgWVjA==',key_name='tempest-keypair-1957671487',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:48:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07258fd0d1784a0584f05238888556d7',ramdisk_id='',reservation_id='r-gc00zg80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1416245590',owner_user_name='tempest-ServerActionsV293TestJSON-1416245590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:48:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28a10069ba1b486491a647c7aaec3324',uuid=87bdf189-555c-4bf1-85cb-b5eed3753dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converting VIF {"id": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "address": "fa:16:3e:c5:d1:85", "network": {"id": "0a72a445-ec1b-4d60-939c-1e4224a7dd3a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-678689462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07258fd0d1784a0584f05238888556d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969e1ff4-cb", "ovs_interfaceid": "969e1ff4-cb79-4f35-9121-d34f9ef7849d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_vif [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap969e1ff4-cb, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:51 user nova-compute[73029]: INFO os_vif [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=969e1ff4-cb79-4f35-9121-d34f9ef7849d,network=Network(0a72a445-ec1b-4d60-939c-1e4224a7dd3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969e1ff4-cb')
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRHeCZFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:49:51 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0999bc90-4c33-4148-8f9a-feced3b362c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[727c5d17-d0d8-41c6-804c-cb688fb5c15d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:51 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:51 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:49:51 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:49:51 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:51 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:51 user nova-compute[73029]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 (non-flash)
Aug 10 00:49:51 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:49:51 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141a70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710'): ({'sde'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Removing single pathed devices sde {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ee92d-e3c1-4c3d-a22c-83979484bc6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17e3c7a-0f97-44a9-8530-367caee5c8f4]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Flushing IO for device /dev/sde {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf9e547-450e-4fd0-a7b0-7d8bca3011e2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4164d6-47d0-4616-8b50-4f595c37f28e]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] SCSI volumes sde have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9c79f26e-c9124f8b366353b2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9c79f26e', '/dev/disk/by-id/scsi-26339313234663862') {{(pid=84041) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0967dee9-ea99-4558-9186-e3e42bbdfaf8]: (4, None) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[80629583-7ef4-4f4f-948f-1086f54b2d7d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[29790e70-3bcc-4dad-9509-348f8e0ef786]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260]
Aug 10 00:49:51 user nova-compute[73029]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710, portal: 172.16.0.220,3260] successful.
Aug 10 00:49:51 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6cae31c-7aeb-4937-9ac3-38b62c30c710 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ca7293-8de5-4d1a-a026-670eafce2a6d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] <== disconnect_volume: return (292ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:49:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Deleting instance files /opt/stack/data/nova/instances/87bdf189-555c-4bf1-85cb-b5eed3753dca_del
Aug 10 00:49:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Deletion of /opt/stack/data/nova/instances/87bdf189-555c-4bf1-85cb-b5eed3753dca_del complete
Aug 10 00:49:51 user nova-compute[73029]: INFO nova.compute.manager [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:51 user nova-compute[73029]: INFO nova.compute.manager [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Terminating instance
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:51 user nova-compute[73029]: INFO nova.compute.manager [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Terminating instance
Aug 10 00:49:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4ddcb915-4869-4e6c-a605-13b3097a46e8 req-a8b9f2a7-42eb-4c4b-a682-a00be5157336 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received event network-vif-unplugged-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4ddcb915-4869-4e6c-a605-13b3097a46e8 req-a8b9f2a7-42eb-4c4b-a682-a00be5157336 service nova] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4ddcb915-4869-4e6c-a605-13b3097a46e8 req-a8b9f2a7-42eb-4c4b-a682-a00be5157336 service nova] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4ddcb915-4869-4e6c-a605-13b3097a46e8 req-a8b9f2a7-42eb-4c4b-a682-a00be5157336 service nova] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4ddcb915-4869-4e6c-a605-13b3097a46e8 req-a8b9f2a7-42eb-4c4b-a682-a00be5157336 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] No waiting events found dispatching network-vif-unplugged-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-4ddcb915-4869-4e6c-a605-13b3097a46e8 req-a8b9f2a7-42eb-4c4b-a682-a00be5157336 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received event network-vif-unplugged-a6681947-5c76-41a4-9552-65c920662ec7 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-92080162-516e-44ff-9da7-f5f8186d4f3a req-80b4d72d-10a8-4670-84c7-657937e43d4d service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-92080162-516e-44ff-9da7-f5f8186d4f3a req-80b4d72d-10a8-4670-84c7-657937e43d4d service nova] Acquiring lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-92080162-516e-44ff-9da7-f5f8186d4f3a req-80b4d72d-10a8-4670-84c7-657937e43d4d service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-92080162-516e-44ff-9da7-f5f8186d4f3a req-80b4d72d-10a8-4670-84c7-657937e43d4d service nova] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-92080162-516e-44ff-9da7-f5f8186d4f3a req-80b4d72d-10a8-4670-84c7-657937e43d4d service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] No waiting events found dispatching network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:52 user nova-compute[73029]: WARNING nova.compute.manager [req-92080162-516e-44ff-9da7-f5f8186d4f3a req-80b4d72d-10a8-4670-84c7-657937e43d4d service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received unexpected event network-vif-plugged-969e1ff4-cb79-4f35-9121-d34f9ef7849d for instance with vm_state active and task_state deleting.
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Instance destroyed successfully.
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lazy-loading 'resources' on Instance uuid bda1d893-0d5b-46da-9f32-b0e2402c28aa {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1363642858',display_name='tempest-AttachVolumeNegativeTest-server-1363642858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1363642858',id=26,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhs88oeBqTqR+I5t0uhcLzwR0Ss77OBbGDh7eBdM2dDEk9bnvJjcKVW55zSITec32fXWIw9nVcT6Pk3igrAWZoygWJx3pBi+A+M87mqSKYL0Btb89rpnYoZXegEzgdLlw==',key_name='tempest-keypair-1548422185',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:47:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22ec174542da4ef6ac5751fb12c9f808',ramdisk_id='',reservation_id='r-xml2xa05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-685145765',owner_user_name='tempest-AttachVolumeNegativeTest-685145765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad4b1f5525d54f399db688f2ff7f0752',uuid=bda1d893-0d5b-46da-9f32-b0e2402c28aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converting VIF {"id": "a6681947-5c76-41a4-9552-65c920662ec7", "address": "fa:16:3e:05:49:59", "network": {"id": "79b52a29-7cb3-48f4-8f4a-87138507f454", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-631287215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22ec174542da4ef6ac5751fb12c9f808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6681947-5c", "ovs_interfaceid": "a6681947-5c76-41a4-9552-65c920662ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:49:59,bridge_name='br-int',has_traffic_filtering=True,id=a6681947-5c76-41a4-9552-65c920662ec7,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6681947-5c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG os_vif [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:49:59,bridge_name='br-int',has_traffic_filtering=True,id=a6681947-5c76-41a4-9552-65c920662ec7,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6681947-5c') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6681947-5c, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: INFO os_vif [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:49:59,bridge_name='br-int',has_traffic_filtering=True,id=a6681947-5c76-41a4-9552-65c920662ec7,network=Network(79b52a29-7cb3-48f4-8f4a-87138507f454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6681947-5c')
Aug 10 00:49:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Deleting instance files /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa_del
Aug 10 00:49:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Deletion of /opt/stack/data/nova/instances/bda1d893-0d5b-46da-9f32-b0e2402c28aa_del complete
Aug 10 00:49:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Instance destroyed successfully.
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lazy-loading 'resources' on Instance uuid c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-269092502',display_name='tempest-ServerActionsTestOtherB-server-269092502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-269092502',id=19,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItzikrNamyVCnXNCeYWOUlFND2bQ8Tuk4qPbQ4GANcUlImEfJj3KUpqnSakA5oCLo1HOK7tJ0c86mCVYnqC3w/Zcx+l5l4Z97MDUOsNoNFHs+ZvBbIlKUjuqYy9iRb8Lw==',key_name='tempest-keypair-1753578335',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:47:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74ad7b2647e5407b89ce46595c1fc9e8',ramdisk_id='',reservation_id='r-e1uzv60r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-539813810',owner_user_name='tempest-ServerActionsTestOtherB-539813810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1bb9034314565893a8d3629f8cd0c',uuid=c4da58fe-aaf3-413d-aa56-48cf53e3a1d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converting VIF {"id": "7e775285-84c8-4049-9914-d6b201090b0a", "address": "fa:16:3e:6b:32:5a", "network": {"id": "8a8d7add-901f-483a-9bda-6da160f9e624", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-817317076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74ad7b2647e5407b89ce46595c1fc9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e775285-84", "ovs_interfaceid": "7e775285-84c8-4049-9914-d6b201090b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG os_vif [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e775285-84, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:49:52 user nova-compute[73029]: INFO os_vif [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:32:5a,bridge_name='br-int',has_traffic_filtering=True,id=7e775285-84c8-4049-9914-d6b201090b0a,network=Network(8a8d7add-901f-483a-9bda-6da160f9e624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e775285-84')
Aug 10 00:49:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjLUxpTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:49:52 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:49:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:49:52 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:53 user nova-compute[73029]: INFO nova.compute.manager [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdb4b32-5016-4ed5-8ef3-bf405a4d7089]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4542177-9310-4480-a90d-f0fab2edeaf7]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:53 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:53 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:49:53 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:49:53 user nova-compute[73029]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 (non-flash)
Aug 10 00:49:53 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:49:53 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141bdb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff0cbe-8f74-4cd2-83e1-c242c119a40d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c357ff20-fdcf-4978-992e-e35a0615ae37]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99eaf04-654f-4d86-815f-65dc3024c4e9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc54a333-ce1e-4d66-af7a-f29fe9d26ee1]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e21a0f-8027-4507-a5b9-1fbfb78351d3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:53 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Took 1.75 seconds to deallocate network for instance.
Aug 10 00:49:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-54fa032d-6a83-4966-a3c6-cd1e4c893175 req-141df1bd-5c8b-4f0b-b53b-6781c409bf42 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Received event network-vif-deleted-969e1ff4-cb79-4f35-9121-d34f9ef7849d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:53 user nova-compute[73029]: INFO nova.compute.manager [req-54fa032d-6a83-4966-a3c6-cd1e4c893175 req-141df1bd-5c8b-4f0b-b53b-6781c409bf42 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Neutron deleted interface 969e1ff4-cb79-4f35-9121-d34f9ef7849d; detaching it from the instance and deleting it from the info cache
Aug 10 00:49:53 user nova-compute[73029]: DEBUG nova.network.neutron [req-54fa032d-6a83-4966-a3c6-cd1e4c893175 req-141df1bd-5c8b-4f0b-b53b-6781c409bf42 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-54fa032d-6a83-4966-a3c6-cd1e4c893175 req-141df1bd-5c8b-4f0b-b53b-6781c409bf42 service nova] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Detach interface failed, port_id=969e1ff4-cb79-4f35-9121-d34f9ef7849d, reason: Instance 87bdf189-555c-4bf1-85cb-b5eed3753dca could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3d35d1-fe59-4a76-837f-b4743110cf47]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260]
Aug 10 00:49:53 user nova-compute[73029]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4, portal: 172.16.0.220,3260] successful.
Aug 10 00:49:53 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efab513d-9a6c-4422-8efc-501492f13fa4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe28b2f-0676-42ef-8286-8255804816b9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] <== disconnect_volume: return (304ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:49:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Deleting instance files /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5_del
Aug 10 00:49:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Deletion of /opt/stack/data/nova/instances/c4da58fe-aaf3-413d-aa56-48cf53e3a1d5_del complete
Aug 10 00:49:53 user nova-compute[73029]: INFO nova.compute.manager [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Took 1.65 seconds to destroy the instance on the hypervisor.
Aug 10 00:49:53 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:54 user nova-compute[73029]: INFO nova.compute.manager [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Took 0.78 seconds to detach 1 volumes for instance.
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Deleting volume: e6cae31c-7aeb-4937-9ac3-38b62c30c710 {{(pid=73029) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received event network-vif-plugged-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] Acquiring lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] No waiting events found dispatching network-vif-plugged-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:54 user nova-compute[73029]: WARNING nova.compute.manager [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received unexpected event network-vif-plugged-a6681947-5c76-41a4-9552-65c920662ec7 for instance with vm_state active and task_state deleting.
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-unplugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-unplugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-unplugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] Acquiring lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] No waiting events found dispatching network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:49:54 user nova-compute[73029]: WARNING nova.compute.manager [req-d3bc642c-b327-4215-8a69-dde62eaa4da9 req-e2e32031-e752-4071-a577-a6c7c543d47e service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received unexpected event network-vif-plugged-7e775285-84c8-4049-9914-d6b201090b0a for instance with vm_state active and task_state deleting.
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:54 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Deleted allocations for instance 87bdf189-555c-4bf1-85cb-b5eed3753dca
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:49:54 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Took 1.52 seconds to deallocate network for instance.
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-918bcddf-7553-49ac-a6b0-4c4d09b291be tempest-ServerActionsV293TestJSON-1416245590 tempest-ServerActionsV293TestJSON-1416245590-project-member] Lock "87bdf189-555c-4bf1-85cb-b5eed3753dca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.278s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:49:54 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Took 1.28 seconds to deallocate network for instance.
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:54 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Deleted allocations for instance bda1d893-0d5b-46da-9f32-b0e2402c28aa
Aug 10 00:49:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bed658fd-6244-4cc6-8114-a28ccb6d78de tempest-AttachVolumeNegativeTest-685145765 tempest-AttachVolumeNegativeTest-685145765-project-member] Lock "bda1d893-0d5b-46da-9f32-b0e2402c28aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.353s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-c03caec1-ed5f-4653-abc6-fd6018e944de req-8a3da58a-c94c-433e-ae68-5912d2a35fe3 service nova] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Received event network-vif-deleted-a6681947-5c76-41a4-9552-65c920662ec7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-c03caec1-ed5f-4653-abc6-fd6018e944de req-8a3da58a-c94c-433e-ae68-5912d2a35fe3 service nova] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Received event network-vif-deleted-7e775285-84c8-4049-9914-d6b201090b0a {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:49:55 user nova-compute[73029]: INFO nova.compute.manager [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Took 0.72 seconds to detach 1 volumes for instance.
Aug 10 00:49:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:49:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:49:55 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:49:55 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:49:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:55 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Deleted allocations for instance c4da58fe-aaf3-413d-aa56-48cf53e3a1d5
Aug 10 00:49:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5d7c6047-e668-48c1-8f0c-98ff2ef1f052 tempest-ServerActionsTestOtherB-539813810 tempest-ServerActionsTestOtherB-539813810-project-member] Lock "c4da58fe-aaf3-413d-aa56-48cf53e3a1d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.138s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:49:57 user nova-compute[73029]: INFO nova.compute.manager [None req-34e061c1-eddd-464b-a951-74c5d168d01d tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Get console output
Aug 10 00:49:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:49:57 user nova-compute[73029]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 10 00:49:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:06 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628591.0743864, 87bdf189-555c-4bf1-85cb-b5eed3753dca => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:50:06 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] VM Stopped (Lifecycle Event)
Aug 10 00:50:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-eb155e8c-36e8-47ed-ac32-49abfae508f9 None None] [instance: 87bdf189-555c-4bf1-85cb-b5eed3753dca] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:50:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:07 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628592.7527385, bda1d893-0d5b-46da-9f32-b0e2402c28aa => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:50:07 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] VM Stopped (Lifecycle Event)
Aug 10 00:50:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-82476473-cb96-4818-a3ff-dadc1ad9fb79 None None] [instance: bda1d893-0d5b-46da-9f32-b0e2402c28aa] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:50:07 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628592.820388, c4da58fe-aaf3-413d-aa56-48cf53e3a1d5 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:50:07 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] VM Stopped (Lifecycle Event)
Aug 10 00:50:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-48e913aa-99bd-4735-a442-139efbedaeb8 None None] [instance: c4da58fe-aaf3-413d-aa56-48cf53e3a1d5] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:50:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:50:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:50:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updating instance_info_cache with network_info: [{"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:50:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:50:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:50:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:50:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=25.2755126953125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a759a046-b39b-4c7d-88ce-bf6922af5a81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 6138a253-2316-4468-b8f9-9268b1b4ded1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 03d2b73d-de9a-4669-8d31-f3d38063faac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-e1c1e08c-38bb-4009-ace8-a8b0f3728b51 req-5bfb4657-4ce4-4e79-9f56-9242a0bcee8a service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-changed-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-e1c1e08c-38bb-4009-ace8-a8b0f3728b51 req-5bfb4657-4ce4-4e79-9f56-9242a0bcee8a service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Refreshing instance network info cache due to event network-changed-5b34c38b-4298-4f65-807d-1ca3bc317978. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e1c1e08c-38bb-4009-ace8-a8b0f3728b51 req-5bfb4657-4ce4-4e79-9f56-9242a0bcee8a service nova] Acquiring lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e1c1e08c-38bb-4009-ace8-a8b0f3728b51 req-5bfb4657-4ce4-4e79-9f56-9242a0bcee8a service nova] Acquired lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG nova.network.neutron [req-e1c1e08c-38bb-4009-ace8-a8b0f3728b51 req-5bfb4657-4ce4-4e79-9f56-9242a0bcee8a service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Refreshing network info cache for port 5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG nova.objects.instance [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'flavor' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:31 user nova-compute[73029]: INFO nova.compute.manager [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Attaching volume d2cd3aa8-5735-4614-8a26-08ac3f7a1199 to /dev/vdb
Aug 10 00:50:31 user nova-compute[73029]: DEBUG os_brick.utils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1468b343-f49b-4cf3-bb66-f69399f3387e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6fdb9e-3823-404e-89e2-135195ae041d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89160a8-6331-4af4-be0e-c5e1098807bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b136cf7-98de-47ce-9a86-2e4795cb0f55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:50:31 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c4c7be-ea46-428d-a954-5bc63867cf02]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG os_brick.utils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating existing volume attachment record: 280d7e92-eb39-4f09-8544-01576ea09ded {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG nova.network.neutron [req-e1c1e08c-38bb-4009-ace8-a8b0f3728b51 req-5bfb4657-4ce4-4e79-9f56-9242a0bcee8a service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updated VIF entry in instance network info cache for port 5b34c38b-4298-4f65-807d-1ca3bc317978. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG nova.network.neutron [req-e1c1e08c-38bb-4009-ace8-a8b0f3728b51 req-5bfb4657-4ce4-4e79-9f56-9242a0bcee8a service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating instance_info_cache with network_info: [{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e1c1e08c-38bb-4009-ace8-a8b0f3728b51 req-5bfb4657-4ce4-4e79-9f56-9242a0bcee8a service nova] Releasing lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:50:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQmCqGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:50:40 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:50:40 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:50:40 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fe7cb2-0eac-42c1-acd3-e6cdd6d97d23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:50:40 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[723bcef8-a22e-4573-9cad-7783253fa2ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199] added
Aug 10 00:50:40 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f570bde9-6bc9-4d4f-b619-d87bb68e1a10]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[59316c8c-9711-45b0-bec0-450b7327c613]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQmCqGHi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQmCqGHi" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[311aa34e-b24f-42de-8e5c-082a899b480b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MQmCqGHi'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfca2c4-269c-45d1-8095-340a3528739c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f696a847-4ca1-4f58-9fd2-95cd5cb96a83]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c17546-13d1-45b9-bfa1-93f36a381cd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199, portal: 172.16.0.220,3260]
Aug 10 00:50:40 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199, portal: 172.16.0.220,3260] successful.
Aug 10 00:50:40 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[88342479-a1b0-4249-882c-71aa398e413e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fca105-8115-4319-8322-2b222edc3583]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:50:40 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fac6079-67ab-4d2b-a051-011997d8f74b]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:50:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQmCqGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:50:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:50:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23531323162316166', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:50:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531323162316166', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:50:41 user nova-compute[73029]: DEBUG nova.objects.instance [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'flavor' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:50:41 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:50:41 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:50:41 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:50:41 user nova-compute[73029]:   <serial>d2cd3aa8-5735-4614-8a26-08ac3f7a1199</serial>
Aug 10 00:50:41 user nova-compute[73029]: </disk>
Aug 10 00:50:41 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:50:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:50:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:50:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No VIF found with MAC fa:16:3e:e9:ee:58, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:50:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-633e047d-79a3-493e-ae95-47c13fafe2eb tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.130s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:50:43 user nova-compute[73029]: INFO nova.compute.manager [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Rescuing
Aug 10 00:50:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:50:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquired lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:50:43 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating instance_info_cache with network_info: [{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Releasing lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-e33a0447-31f2-44b5-ae07-ac91dfd6ae73 req-531a6264-2dd4-4a7c-ad5e-68811c2d84c1 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-unplugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e33a0447-31f2-44b5-ae07-ac91dfd6ae73 req-531a6264-2dd4-4a7c-ad5e-68811c2d84c1 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e33a0447-31f2-44b5-ae07-ac91dfd6ae73 req-531a6264-2dd4-4a7c-ad5e-68811c2d84c1 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e33a0447-31f2-44b5-ae07-ac91dfd6ae73 req-531a6264-2dd4-4a7c-ad5e-68811c2d84c1 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-e33a0447-31f2-44b5-ae07-ac91dfd6ae73 req-531a6264-2dd4-4a7c-ad5e-68811c2d84c1 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-unplugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:50:44 user nova-compute[73029]: WARNING nova.compute.manager [req-e33a0447-31f2-44b5-ae07-ac91dfd6ae73 req-531a6264-2dd4-4a7c-ad5e-68811c2d84c1 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-unplugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state active and task_state rescuing.
Aug 10 00:50:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Instance destroyed successfully.
Aug 10 00:50:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Attempting rescue
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73029) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Instance directory exists: not creating {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 10 00:50:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Creating image(s)
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'trusted_certs' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue" returned: 0 in 0.087s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'migration_context' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Start _get_guest_xml network_info=[{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "vif_mac": "fa:16:3e:e9:ee:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'resources' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'numa_topology' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:45 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:50:45 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-398395019',display_name='tempest-ServerRescueNegativeTestJSON-server-398395019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-398395019',id=28,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7gu9lAx8RZscHpV51sLlq+jmbUmX3cj6dU9fSYJOfds8jWOFd+VGlw8A3s5DhjojkrDtcsYc3LmedBHmlwJ8c4jMklrj3BDyOgOoPfuiptIqbnAnTxkAkejQV+KuITlg==',key_name='tempest-keypair-2057180871',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:48:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-m8028215',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a4fb6b058c64442b1688a3962849322',uuid=03d2b73d-de9a-4669-8d31-f3d38063faac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "vif_mac": "fa:16:3e:e9:ee:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "vif_mac": "fa:16:3e:e9:ee:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ee:58,bridge_name='br-int',has_traffic_filtering=True,id=5b34c38b-4298-4f65-807d-1ca3bc317978,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b34c38b-42') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'pci_devices' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:50:45 user nova-compute[73029]:   <uuid>03d2b73d-de9a-4669-8d31-f3d38063faac</uuid>
Aug 10 00:50:45 user nova-compute[73029]:   <name>instance-0000001c</name>
Aug 10 00:50:45 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:50:45 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:50:45 user nova-compute[73029]:   <metadata>
Aug 10 00:50:45 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:50:45 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:50:45 user nova-compute[73029]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-398395019</nova:name>
Aug 10 00:50:45 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:50:45</nova:creationTime>
Aug 10 00:50:45 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:50:45 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:50:45 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:50:45 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:50:45 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:50:45 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:50:45 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:50:45 user nova-compute[73029]:       <nova:owner>
Aug 10 00:50:45 user nova-compute[73029]:         <nova:user uuid="4a4fb6b058c64442b1688a3962849322">tempest-ServerRescueNegativeTestJSON-1160585559-project-member</nova:user>
Aug 10 00:50:45 user nova-compute[73029]:         <nova:project uuid="e54d7ee7b2c741e2bbc4a1fb4a2cc042">tempest-ServerRescueNegativeTestJSON-1160585559</nova:project>
Aug 10 00:50:45 user nova-compute[73029]:       </nova:owner>
Aug 10 00:50:45 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:50:45 user nova-compute[73029]:       <nova:ports>
Aug 10 00:50:45 user nova-compute[73029]:         <nova:port uuid="5b34c38b-4298-4f65-807d-1ca3bc317978">
Aug 10 00:50:45 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 10 00:50:45 user nova-compute[73029]:         </nova:port>
Aug 10 00:50:45 user nova-compute[73029]:       </nova:ports>
Aug 10 00:50:45 user nova-compute[73029]:     </nova:instance>
Aug 10 00:50:45 user nova-compute[73029]:   </metadata>
Aug 10 00:50:45 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:50:45 user nova-compute[73029]:     <system>
Aug 10 00:50:45 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:50:45 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:50:45 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:50:45 user nova-compute[73029]:       <entry name="serial">03d2b73d-de9a-4669-8d31-f3d38063faac</entry>
Aug 10 00:50:45 user nova-compute[73029]:       <entry name="uuid">03d2b73d-de9a-4669-8d31-f3d38063faac</entry>
Aug 10 00:50:45 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:50:45 user nova-compute[73029]:     </system>
Aug 10 00:50:45 user nova-compute[73029]:   </sysinfo>
Aug 10 00:50:45 user nova-compute[73029]:   <os>
Aug 10 00:50:45 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:50:45 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:50:45 user nova-compute[73029]:   </os>
Aug 10 00:50:45 user nova-compute[73029]:   <features>
Aug 10 00:50:45 user nova-compute[73029]:     <acpi/>
Aug 10 00:50:45 user nova-compute[73029]:     <apic/>
Aug 10 00:50:45 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:50:45 user nova-compute[73029]:   </features>
Aug 10 00:50:45 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:50:45 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:50:45 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:50:45 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:50:45 user nova-compute[73029]:   </clock>
Aug 10 00:50:45 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:50:45 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:50:45 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:50:45 user nova-compute[73029]:   </cpu>
Aug 10 00:50:45 user nova-compute[73029]:   <devices>
Aug 10 00:50:45 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:50:45 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:50:45 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue"/>
Aug 10 00:50:45 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:50:45 user nova-compute[73029]:     </disk>
Aug 10 00:50:45 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:50:45 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:50:45 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk"/>
Aug 10 00:50:45 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:50:45 user nova-compute[73029]:     </disk>
Aug 10 00:50:45 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:50:45 user nova-compute[73029]:       <mac address="fa:16:3e:e9:ee:58"/>
Aug 10 00:50:45 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:50:45 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:50:45 user nova-compute[73029]:       <target dev="tap5b34c38b-42"/>
Aug 10 00:50:45 user nova-compute[73029]:     </interface>
Aug 10 00:50:45 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:50:45 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/console.log" append="off"/>
Aug 10 00:50:45 user nova-compute[73029]:     </serial>
Aug 10 00:50:45 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:50:45 user nova-compute[73029]:     <video>
Aug 10 00:50:45 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:50:45 user nova-compute[73029]:     </video>
Aug 10 00:50:45 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:50:45 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:50:45 user nova-compute[73029]:     </rng>
Aug 10 00:50:45 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:50:45 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:50:45 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:50:45 user nova-compute[73029]:     </memballoon>
Aug 10 00:50:45 user nova-compute[73029]:   </devices>
Aug 10 00:50:45 user nova-compute[73029]: </domain>
Aug 10 00:50:45 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:50:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Instance destroyed successfully.
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:50:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] No VIF found with MAC fa:16:3e:e9:ee:58, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:50:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-b9541696-3a2f-4f54-bf5c-503f68b659bd req-fb4e2226-b0aa-41e8-b8c8-53a39f121ad4 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:50:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b9541696-3a2f-4f54-bf5c-503f68b659bd req-fb4e2226-b0aa-41e8-b8c8-53a39f121ad4 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b9541696-3a2f-4f54-bf5c-503f68b659bd req-fb4e2226-b0aa-41e8-b8c8-53a39f121ad4 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b9541696-3a2f-4f54-bf5c-503f68b659bd req-fb4e2226-b0aa-41e8-b8c8-53a39f121ad4 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-b9541696-3a2f-4f54-bf5c-503f68b659bd req-fb4e2226-b0aa-41e8-b8c8-53a39f121ad4 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:50:46 user nova-compute[73029]: WARNING nova.compute.manager [req-b9541696-3a2f-4f54-bf5c-503f68b659bd req-fb4e2226-b0aa-41e8-b8c8-53a39f121ad4 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state active and task_state rescuing.
Aug 10 00:50:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:50:48 user nova-compute[73029]: WARNING nova.compute.manager [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state active and task_state rescuing.
Aug 10 00:50:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:50:48 user nova-compute[73029]: WARNING nova.compute.manager [req-2d09a65d-6df1-415e-b385-0edde2ba8160 req-cb8733d0-1d3c-41b2-84a5-338c10944bd2 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state active and task_state rescuing.
Aug 10 00:50:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 03d2b73d-de9a-4669-8d31-f3d38063faac due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:50:49 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628649.3737092, 03d2b73d-de9a-4669-8d31-f3d38063faac => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:50:49 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] VM Resumed (Lifecycle Event)
Aug 10 00:50:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2ce3854c-f432-4dd9-b608-560f4ea3feaa tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:50:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:50:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:50:49 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 10 00:50:49 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628649.377468, 03d2b73d-de9a-4669-8d31-f3d38063faac => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:50:49 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] VM Started (Lifecycle Event)
Aug 10 00:50:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:50:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:50:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:50:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:55 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:50:55 user nova-compute[73029]: INFO nova.compute.claims [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Claim successful on node user
Aug 10 00:50:56 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:50:56 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:50:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG nova.policy [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d34a91746034f349b7eeccfd372f21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39027fdade2f41048db7d3855f3197cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:50:56 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Creating image(s)
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "/opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "/opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.159s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk 1073741824" returned: 0 in 0.069s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.157s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Successfully created port: 5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Cannot resize image /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'migration_context' on Instance uuid 1c23f226-a16a-4158-bac9-b9d78381fb5c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Ensure instance console log exists: /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Successfully updated port: 5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquired lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-afca2ba7-acfd-4de9-8e5f-1cdbeef44f55 req-8bf30a9e-f543-4dcd-964d-c712102eb3fc service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received event network-changed-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-afca2ba7-acfd-4de9-8e5f-1cdbeef44f55 req-8bf30a9e-f543-4dcd-964d-c712102eb3fc service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Refreshing instance network info cache due to event network-changed-5433e300-24ad-4db0-99ee-b477443a14ff. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-afca2ba7-acfd-4de9-8e5f-1cdbeef44f55 req-8bf30a9e-f543-4dcd-964d-c712102eb3fc service nova] Acquiring lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:50:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updating instance_info_cache with network_info: [{"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Releasing lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Instance network_info: |[{"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-afca2ba7-acfd-4de9-8e5f-1cdbeef44f55 req-8bf30a9e-f543-4dcd-964d-c712102eb3fc service nova] Acquired lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.network.neutron [req-afca2ba7-acfd-4de9-8e5f-1cdbeef44f55 req-8bf30a9e-f543-4dcd-964d-c712102eb3fc service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Refreshing network info cache for port 5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Start _get_guest_xml network_info=[{"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:50:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:50:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-200828680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-200828680',id=29,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-hpoxeefp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:50:56Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=1c23f226-a16a-4158-bac9-b9d78381fb5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:3f:a0,bridge_name='br-int',has_traffic_filtering=True,id=5433e300-24ad-4db0-99ee-b477443a14ff,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5433e300-24') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c23f226-a16a-4158-bac9-b9d78381fb5c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:50:58 user nova-compute[73029]:   <uuid>1c23f226-a16a-4158-bac9-b9d78381fb5c</uuid>
Aug 10 00:50:58 user nova-compute[73029]:   <name>instance-0000001d</name>
Aug 10 00:50:58 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:50:58 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:50:58 user nova-compute[73029]:   <metadata>
Aug 10 00:50:58 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:50:58 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:50:58 user nova-compute[73029]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-200828680</nova:name>
Aug 10 00:50:58 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:50:58</nova:creationTime>
Aug 10 00:50:58 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:50:58 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:50:58 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:50:58 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:50:58 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:50:58 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:50:58 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:50:58 user nova-compute[73029]:       <nova:owner>
Aug 10 00:50:58 user nova-compute[73029]:         <nova:user uuid="6d34a91746034f349b7eeccfd372f21a">tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member</nova:user>
Aug 10 00:50:58 user nova-compute[73029]:         <nova:project uuid="39027fdade2f41048db7d3855f3197cc">tempest-ServerBootFromVolumeStableRescueTest-1463443327</nova:project>
Aug 10 00:50:58 user nova-compute[73029]:       </nova:owner>
Aug 10 00:50:58 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:50:58 user nova-compute[73029]:       <nova:ports>
Aug 10 00:50:58 user nova-compute[73029]:         <nova:port uuid="5433e300-24ad-4db0-99ee-b477443a14ff">
Aug 10 00:50:58 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 10 00:50:58 user nova-compute[73029]:         </nova:port>
Aug 10 00:50:58 user nova-compute[73029]:       </nova:ports>
Aug 10 00:50:58 user nova-compute[73029]:     </nova:instance>
Aug 10 00:50:58 user nova-compute[73029]:   </metadata>
Aug 10 00:50:58 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:50:58 user nova-compute[73029]:     <system>
Aug 10 00:50:58 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:50:58 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:50:58 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:50:58 user nova-compute[73029]:       <entry name="serial">1c23f226-a16a-4158-bac9-b9d78381fb5c</entry>
Aug 10 00:50:58 user nova-compute[73029]:       <entry name="uuid">1c23f226-a16a-4158-bac9-b9d78381fb5c</entry>
Aug 10 00:50:58 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:50:58 user nova-compute[73029]:     </system>
Aug 10 00:50:58 user nova-compute[73029]:   </sysinfo>
Aug 10 00:50:58 user nova-compute[73029]:   <os>
Aug 10 00:50:58 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:50:58 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:50:58 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:50:58 user nova-compute[73029]:   </os>
Aug 10 00:50:58 user nova-compute[73029]:   <features>
Aug 10 00:50:58 user nova-compute[73029]:     <acpi/>
Aug 10 00:50:58 user nova-compute[73029]:     <apic/>
Aug 10 00:50:58 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:50:58 user nova-compute[73029]:   </features>
Aug 10 00:50:58 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:50:58 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:50:58 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:50:58 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:50:58 user nova-compute[73029]:   </clock>
Aug 10 00:50:58 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:50:58 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:50:58 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:50:58 user nova-compute[73029]:   </cpu>
Aug 10 00:50:58 user nova-compute[73029]:   <devices>
Aug 10 00:50:58 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:50:58 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:50:58 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk"/>
Aug 10 00:50:58 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:50:58 user nova-compute[73029]:     </disk>
Aug 10 00:50:58 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:50:58 user nova-compute[73029]:       <mac address="fa:16:3e:bd:3f:a0"/>
Aug 10 00:50:58 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:50:58 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:50:58 user nova-compute[73029]:       <target dev="tap5433e300-24"/>
Aug 10 00:50:58 user nova-compute[73029]:     </interface>
Aug 10 00:50:58 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:50:58 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/console.log" append="off"/>
Aug 10 00:50:58 user nova-compute[73029]:     </serial>
Aug 10 00:50:58 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:50:58 user nova-compute[73029]:     <video>
Aug 10 00:50:58 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:50:58 user nova-compute[73029]:     </video>
Aug 10 00:50:58 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:50:58 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:50:58 user nova-compute[73029]:     </rng>
Aug 10 00:50:58 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:50:58 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:50:58 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:50:58 user nova-compute[73029]:     </memballoon>
Aug 10 00:50:58 user nova-compute[73029]:   </devices>
Aug 10 00:50:58 user nova-compute[73029]: </domain>
Aug 10 00:50:58 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-200828680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-200828680',id=29,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-hpoxeefp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:50:56Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=1c23f226-a16a-4158-bac9-b9d78381fb5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:3f:a0,bridge_name='br-int',has_traffic_filtering=True,id=5433e300-24ad-4db0-99ee-b477443a14ff,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5433e300-24') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG os_vif [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:3f:a0,bridge_name='br-int',has_traffic_filtering=True,id=5433e300-24ad-4db0-99ee-b477443a14ff,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5433e300-24') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5433e300-24, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5433e300-24, col_values=(('external_ids', {'iface-id': '5433e300-24ad-4db0-99ee-b477443a14ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:3f:a0', 'vm-uuid': '1c23f226-a16a-4158-bac9-b9d78381fb5c'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:58 user nova-compute[73029]: INFO os_vif [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:3f:a0,bridge_name='br-int',has_traffic_filtering=True,id=5433e300-24ad-4db0-99ee-b477443a14ff,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5433e300-24')
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No VIF found with MAC fa:16:3e:bd:3f:a0, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:58 user nova-compute[73029]: INFO nova.compute.manager [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Terminating instance
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.network.neutron [req-afca2ba7-acfd-4de9-8e5f-1cdbeef44f55 req-8bf30a9e-f543-4dcd-964d-c712102eb3fc service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updated VIF entry in instance network info cache for port 5433e300-24ad-4db0-99ee-b477443a14ff. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.network.neutron [req-afca2ba7-acfd-4de9-8e5f-1cdbeef44f55 req-8bf30a9e-f543-4dcd-964d-c712102eb3fc service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updating instance_info_cache with network_info: [{"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-afca2ba7-acfd-4de9-8e5f-1cdbeef44f55 req-8bf30a9e-f543-4dcd-964d-c712102eb3fc service nova] Releasing lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-0d7a0891-0a71-45f7-9831-4e4acbc748d5 req-d21ffd60-ae8e-43b1-833f-082f5971840a service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-unplugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0d7a0891-0a71-45f7-9831-4e4acbc748d5 req-d21ffd60-ae8e-43b1-833f-082f5971840a service nova] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0d7a0891-0a71-45f7-9831-4e4acbc748d5 req-d21ffd60-ae8e-43b1-833f-082f5971840a service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0d7a0891-0a71-45f7-9831-4e4acbc748d5 req-d21ffd60-ae8e-43b1-833f-082f5971840a service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-0d7a0891-0a71-45f7-9831-4e4acbc748d5 req-d21ffd60-ae8e-43b1-833f-082f5971840a service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] No waiting events found dispatching network-vif-unplugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:50:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-0d7a0891-0a71-45f7-9831-4e4acbc748d5 req-d21ffd60-ae8e-43b1-833f-082f5971840a service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-unplugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:50:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Instance destroyed successfully.
Aug 10 00:50:59 user nova-compute[73029]: DEBUG nova.objects.instance [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'resources' on Instance uuid a759a046-b39b-4c7d-88ce-bf6922af5a81 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-774975152',display_name='tempest-ServerActionsTestOtherA-server-774975152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-774975152',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:46:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-6uqo1cb0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=a759a046-b39b-4c7d-88ce-bf6922af5a81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "address": "fa:16:3e:cf:99:04", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e98d91-db", "ovs_interfaceid": "24e98d91-db37-4730-97d2-f9fb3cf8c9a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG os_vif [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24e98d91-db, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:50:59 user nova-compute[73029]: INFO os_vif [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:99:04,bridge_name='br-int',has_traffic_filtering=True,id=24e98d91-db37-4730-97d2-f9fb3cf8c9a0,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e98d91-db')
Aug 10 00:50:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyHhNILq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:50:59 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:50:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ab098e-6ef8-483f-a5d6-6dd63b1f4d4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d129f82-8a53-496a-b546-77c9e1706fbe]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:50:59 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:50:59 user nova-compute[73029]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:50:59 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 (non-flash)
Aug 10 00:50:59 user nova-compute[73029]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:50:59 user nova-compute[73029]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:50:59 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141ce8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8e14d3-7cdc-487b-99ef-2ddb8e6312ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:50:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b8ad8b-815e-479e-b758-eed5d52db4b6]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b26bc00-e774-4295-82f7-2927465c63ea]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d4b4d1-2545-4e88-813d-37a5175711e7]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1418e7-c2a5-4e28-824c-a7eee564acda]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b6cd03-37a0-49db-973e-5b9e78cefc01]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260]
Aug 10 00:51:00 user nova-compute[73029]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227, portal: 172.16.0.220,3260] successful.
Aug 10 00:51:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb934ac5-976b-4e1f-8572-2a365db9d227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d17ec01-0890-48ed-91b3-cb4103857c15]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] <== disconnect_volume: return (352ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:51:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Deleting instance files /opt/stack/data/nova/instances/a759a046-b39b-4c7d-88ce-bf6922af5a81_del
Aug 10 00:51:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Deletion of /opt/stack/data/nova/instances/a759a046-b39b-4c7d-88ce-bf6922af5a81_del complete
Aug 10 00:51:00 user nova-compute[73029]: INFO nova.compute.manager [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Took 1.84 seconds to destroy the instance on the hypervisor.
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-192a9b31-7035-4ed2-a4c8-7adc16588ab9 req-a31f03a5-acad-4214-b592-ae30efc80c73 service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received event network-vif-plugged-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-192a9b31-7035-4ed2-a4c8-7adc16588ab9 req-a31f03a5-acad-4214-b592-ae30efc80c73 service nova] Acquiring lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-192a9b31-7035-4ed2-a4c8-7adc16588ab9 req-a31f03a5-acad-4214-b592-ae30efc80c73 service nova] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-192a9b31-7035-4ed2-a4c8-7adc16588ab9 req-a31f03a5-acad-4214-b592-ae30efc80c73 service nova] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-192a9b31-7035-4ed2-a4c8-7adc16588ab9 req-a31f03a5-acad-4214-b592-ae30efc80c73 service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] No waiting events found dispatching network-vif-plugged-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:51:00 user nova-compute[73029]: WARNING nova.compute.manager [req-192a9b31-7035-4ed2-a4c8-7adc16588ab9 req-a31f03a5-acad-4214-b592-ae30efc80c73 service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received unexpected event network-vif-plugged-5433e300-24ad-4db0-99ee-b477443a14ff for instance with vm_state building and task_state spawning.
Aug 10 00:51:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-2dc4cde9-3734-4726-a9e6-800ff26f3ad2 req-2b2b3feb-d4e5-478b-bcb8-6cd2606f797d service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2dc4cde9-3734-4726-a9e6-800ff26f3ad2 req-2b2b3feb-d4e5-478b-bcb8-6cd2606f797d service nova] Acquiring lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2dc4cde9-3734-4726-a9e6-800ff26f3ad2 req-2b2b3feb-d4e5-478b-bcb8-6cd2606f797d service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2dc4cde9-3734-4726-a9e6-800ff26f3ad2 req-2b2b3feb-d4e5-478b-bcb8-6cd2606f797d service nova] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-2dc4cde9-3734-4726-a9e6-800ff26f3ad2 req-2b2b3feb-d4e5-478b-bcb8-6cd2606f797d service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] No waiting events found dispatching network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:51:00 user nova-compute[73029]: WARNING nova.compute.manager [req-2dc4cde9-3734-4726-a9e6-800ff26f3ad2 req-2b2b3feb-d4e5-478b-bcb8-6cd2606f797d service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received unexpected event network-vif-plugged-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 for instance with vm_state active and task_state deleting.
Aug 10 00:51:01 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:51:01 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Took 1.28 seconds to deallocate network for instance.
Aug 10 00:51:02 user nova-compute[73029]: INFO nova.compute.manager [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Took 0.85 seconds to detach 1 volumes for instance.
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Deleting volume: bb934ac5-976b-4e1f-8572-2a365db9d227 {{(pid=73029) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628662.4963958, 1c23f226-a16a-4158-bac9-b9d78381fb5c => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:51:02 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] VM Resumed (Lifecycle Event)
Aug 10 00:51:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:51:02 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Instance spawned successfully.
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:51:02 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628662.5012, 1c23f226-a16a-4158-bac9-b9d78381fb5c => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:51:02 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] VM Started (Lifecycle Event)
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:51:02 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:51:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:02 user nova-compute[73029]: INFO nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Took 6.23 seconds to spawn the instance on the hypervisor.
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [req-df1e644f-a277-4330-9379-ad9e813bc926 req-ec6ccc2a-9648-46f4-b0bd-29da865cda9f service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received event network-vif-plugged-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-df1e644f-a277-4330-9379-ad9e813bc926 req-ec6ccc2a-9648-46f4-b0bd-29da865cda9f service nova] Acquiring lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-df1e644f-a277-4330-9379-ad9e813bc926 req-ec6ccc2a-9648-46f4-b0bd-29da865cda9f service nova] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-df1e644f-a277-4330-9379-ad9e813bc926 req-ec6ccc2a-9648-46f4-b0bd-29da865cda9f service nova] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [req-df1e644f-a277-4330-9379-ad9e813bc926 req-ec6ccc2a-9648-46f4-b0bd-29da865cda9f service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] No waiting events found dispatching network-vif-plugged-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:51:02 user nova-compute[73029]: WARNING nova.compute.manager [req-df1e644f-a277-4330-9379-ad9e813bc926 req-ec6ccc2a-9648-46f4-b0bd-29da865cda9f service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received unexpected event network-vif-plugged-5433e300-24ad-4db0-99ee-b477443a14ff for instance with vm_state building and task_state spawning.
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.manager [req-df1e644f-a277-4330-9379-ad9e813bc926 req-ec6ccc2a-9648-46f4-b0bd-29da865cda9f service nova] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Received event network-vif-deleted-24e98d91-db37-4730-97d2-f9fb3cf8c9a0 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:51:02 user nova-compute[73029]: INFO nova.compute.manager [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Took 7.05 seconds to build instance.
Aug 10 00:51:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4a26188e-6f6e-456a-91f8-7d8b2e8cf0f3 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.173s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:51:02 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:51:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:03 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Deleted allocations for instance a759a046-b39b-4c7d-88ce-bf6922af5a81
Aug 10 00:51:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93593f7c-4887-4452-80d8-c6bf28f17ce4 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "a759a046-b39b-4c7d-88ce-bf6922af5a81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.718s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:14 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628659.797222, a759a046-b39b-4c7d-88ce-bf6922af5a81 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:51:14 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] VM Stopped (Lifecycle Event)
Aug 10 00:51:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-09d7db3f-1e92-4194-bcea-46da3bb13b79 None None] [instance: a759a046-b39b-4c7d-88ce-bf6922af5a81] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:51:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-fb3bb765-c87b-481b-929b-f528faa63e5a req-a6a2b570-d0be-459b-8dff-283b345a227a service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-fb3bb765-c87b-481b-929b-f528faa63e5a req-a6a2b570-d0be-459b-8dff-283b345a227a service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing instance network info cache due to event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fb3bb765-c87b-481b-929b-f528faa63e5a req-a6a2b570-d0be-459b-8dff-283b345a227a service nova] Acquiring lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fb3bb765-c87b-481b-929b-f528faa63e5a req-a6a2b570-d0be-459b-8dff-283b345a227a service nova] Acquired lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG nova.network.neutron [req-fb3bb765-c87b-481b-929b-f528faa63e5a req-a6a2b570-d0be-459b-8dff-283b345a227a service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing network info cache for port ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG nova.network.neutron [req-fb3bb765-c87b-481b-929b-f528faa63e5a req-a6a2b570-d0be-459b-8dff-283b345a227a service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updated VIF entry in instance network info cache for port ed2decd6-a50d-42f6-9fdf-c08b0e87db91. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG nova.network.neutron [req-fb3bb765-c87b-481b-929b-f528faa63e5a req-a6a2b570-d0be-459b-8dff-283b345a227a service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [{"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:51:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fb3bb765-c87b-481b-929b-f528faa63e5a req-a6a2b570-d0be-459b-8dff-283b345a227a service nova] Releasing lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:51:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-2061b1f1-3204-47fa-9ef3-630722a85687 req-7895a1d3-ffd3-4180-9adc-ff245d7d9833 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:51:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-2061b1f1-3204-47fa-9ef3-630722a85687 req-7895a1d3-ffd3-4180-9adc-ff245d7d9833 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing instance network info cache due to event network-changed-ed2decd6-a50d-42f6-9fdf-c08b0e87db91. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:51:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2061b1f1-3204-47fa-9ef3-630722a85687 req-7895a1d3-ffd3-4180-9adc-ff245d7d9833 service nova] Acquiring lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:51:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2061b1f1-3204-47fa-9ef3-630722a85687 req-7895a1d3-ffd3-4180-9adc-ff245d7d9833 service nova] Acquired lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:51:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-2061b1f1-3204-47fa-9ef3-630722a85687 req-7895a1d3-ffd3-4180-9adc-ff245d7d9833 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Refreshing network info cache for port ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:51:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:21 user nova-compute[73029]: INFO nova.compute.manager [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Detaching volume c3b92cb4-60ee-4539-a20c-9911656cd685
Aug 10 00:51:21 user nova-compute[73029]: INFO nova.virt.block_device [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Attempting to driver detach volume c3b92cb4-60ee-4539-a20c-9911656cd685 from mountpoint /dev/vdb
Aug 10 00:51:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Attempting to detach device vdb from instance 6138a253-2316-4468-b8f9-9268b1b4ded1 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:51:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:51:21 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:51:21 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:51:21 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:51:21 user nova-compute[73029]:   <serial>c3b92cb4-60ee-4539-a20c-9911656cd685</serial>
Aug 10 00:51:21 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:51:21 user nova-compute[73029]: </disk>
Aug 10 00:51:21 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:51:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully detached device vdb from instance 6138a253-2316-4468-b8f9-9268b1b4ded1 from the persistent domain config.
Aug 10 00:51:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6138a253-2316-4468-b8f9-9268b1b4ded1 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:51:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:51:21 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:51:21 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 00:51:21 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:51:21 user nova-compute[73029]:   <serial>c3b92cb4-60ee-4539-a20c-9911656cd685</serial>
Aug 10 00:51:21 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:51:21 user nova-compute[73029]: </disk>
Aug 10 00:51:21 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-2061b1f1-3204-47fa-9ef3-630722a85687 req-7895a1d3-ffd3-4180-9adc-ff245d7d9833 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updated VIF entry in instance network info cache for port ed2decd6-a50d-42f6-9fdf-c08b0e87db91. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-2061b1f1-3204-47fa-9ef3-630722a85687 req-7895a1d3-ffd3-4180-9adc-ff245d7d9833 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [{"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2061b1f1-3204-47fa-9ef3-630722a85687 req-7895a1d3-ffd3-4180-9adc-ff245d7d9833 service nova] Releasing lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628682.269761, 6138a253-2316-4468-b8f9-9268b1b4ded1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6138a253-2316-4468-b8f9-9268b1b4ded1 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:51:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully detached device vdb from instance 6138a253-2316-4468-b8f9-9268b1b4ded1 from the live domain config.
Aug 10 00:51:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyhQzGKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:51:22 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e492882e-9c08-4d2e-b963-aaf602c4289e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2b98ff-de61-48a6-8363-6d63502bd44d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:51:22 user nova-compute[73029]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:51:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 (non-flash)
Aug 10 00:51:22 user nova-compute[73029]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:51:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f0743880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685'): ({'sdd'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Removing single pathed devices sdd {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fc7040-122a-4c15-9f80-3eb4b21618d9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e4b935-4cf9-4ba1-bad9-1502dd58a1ea]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Flushing IO for device /dev/sdd {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[975c73f5-e756-4f75-b826-6101961a1af2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1de3eca-8187-45b4-94f9-b55135a6f2ce]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7a4428-89f6-47ce-b969-5897a26e02f5]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5309b-bb45-493a-89f1-83d9d7fe5151]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685, portal: 172.16.0.220,3260]
Aug 10 00:51:22 user nova-compute[73029]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685, portal: 172.16.0.220,3260] successful.
Aug 10 00:51:22 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b92cb4-60ee-4539-a20c-9911656cd685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a872acc-fa80-490b-9f1e-8cacfe662090]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] <== disconnect_volume: return (282ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:51:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG nova.objects.instance [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'flavor' on Instance uuid 6138a253-2316-4468-b8f9-9268b1b4ded1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e59eb813-a900-4169-885d-b131581daf51 tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.752s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [{"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-6138a253-2316-4468-b8f9-9268b1b4ded1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:51:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:51:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:51:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:51:30 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:51:30 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:51:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=25.224891662597656GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:51:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 6138a253-2316-4468-b8f9-9268b1b4ded1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 03d2b73d-de9a-4669-8d31-f3d38063faac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:31 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:51:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 00:51:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:51:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:51:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:51:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:51:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:51:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:51:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:54 user nova-compute[73029]: INFO nova.compute.manager [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Terminating instance
Aug 10 00:51:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:51:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-1344b3cd-e7f5-4335-8754-c1b861eedd32 req-ba9cce96-8a69-464b-8db6-f71bad2cfdd8 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-unplugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1344b3cd-e7f5-4335-8754-c1b861eedd32 req-ba9cce96-8a69-464b-8db6-f71bad2cfdd8 service nova] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1344b3cd-e7f5-4335-8754-c1b861eedd32 req-ba9cce96-8a69-464b-8db6-f71bad2cfdd8 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1344b3cd-e7f5-4335-8754-c1b861eedd32 req-ba9cce96-8a69-464b-8db6-f71bad2cfdd8 service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-1344b3cd-e7f5-4335-8754-c1b861eedd32 req-ba9cce96-8a69-464b-8db6-f71bad2cfdd8 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] No waiting events found dispatching network-vif-unplugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-1344b3cd-e7f5-4335-8754-c1b861eedd32 req-ba9cce96-8a69-464b-8db6-f71bad2cfdd8 service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-unplugged-756092b1-bc75-4163-a66c-ecaff9bcb39d for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Instance destroyed successfully.
Aug 10 00:51:55 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lazy-loading 'resources' on Instance uuid ee3b2f60-0756-4d77-97ac-11fa0c456c1f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2093299035',display_name='tempest-ServerActionsTestOtherA-server-1126399829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2093299035',id=2,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5cwsLAI66TvMseF5WMn0X8P63WC2FePEjq+W72+q/kdWyFKTFxx/0h+wJ3jsKfRe2ASZ1N2i+Vrv8k4JKwtWHUR+UaYAD2AXZzqy4CJ6oAC+J2lGVXQux5R6S+qaLOag==',key_name='tempest-keypair-135931820',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:39:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60aabdbd31b647d68db993c0a60a43ec',ramdisk_id='',reservation_id='r-1q6bgm1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-916478349',owner_user_name='tempest-ServerActionsTestOtherA-916478349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='066b8c956dd146209ae7ecabfbf083ff',uuid=ee3b2f60-0756-4d77-97ac-11fa0c456c1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converting VIF {"id": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "address": "fa:16:3e:16:10:6b", "network": {"id": "4abb426a-4948-494f-a02f-e3d5693ec3d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-310216871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60aabdbd31b647d68db993c0a60a43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756092b1-bc", "ovs_interfaceid": "756092b1-bc75-4163-a66c-ecaff9bcb39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG os_vif [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap756092b1-bc, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:51:55 user nova-compute[73029]: INFO os_vif [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:10:6b,bridge_name='br-int',has_traffic_filtering=True,id=756092b1-bc75-4163-a66c-ecaff9bcb39d,network=Network(4abb426a-4948-494f-a02f-e3d5693ec3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756092b1-bc')
Aug 10 00:51:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Deleting instance files /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f_del
Aug 10 00:51:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Deletion of /opt/stack/data/nova/instances/ee3b2f60-0756-4d77-97ac-11fa0c456c1f_del complete
Aug 10 00:51:55 user nova-compute[73029]: INFO nova.compute.manager [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 10 00:51:55 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:51:55 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:51:56 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Took 0.54 seconds to deallocate network for instance.
Aug 10 00:51:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-7dc6763b-c4c7-46ac-89da-b4b11dfe5e36 req-4db42d2b-18b2-45e6-8f65-5c6f19fe527d service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-deleted-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:51:56 user nova-compute[73029]: INFO nova.compute.manager [req-7dc6763b-c4c7-46ac-89da-b4b11dfe5e36 req-4db42d2b-18b2-45e6-8f65-5c6f19fe527d service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Neutron deleted interface 756092b1-bc75-4163-a66c-ecaff9bcb39d; detaching it from the instance and deleting it from the info cache
Aug 10 00:51:56 user nova-compute[73029]: DEBUG nova.network.neutron [req-7dc6763b-c4c7-46ac-89da-b4b11dfe5e36 req-4db42d2b-18b2-45e6-8f65-5c6f19fe527d service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-7dc6763b-c4c7-46ac-89da-b4b11dfe5e36 req-4db42d2b-18b2-45e6-8f65-5c6f19fe527d service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Detach interface failed, port_id=756092b1-bc75-4163-a66c-ecaff9bcb39d, reason: Instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:51:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:56 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Deleted allocations for instance ee3b2f60-0756-4d77-97ac-11fa0c456c1f
Aug 10 00:51:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df19e76-ad05-4574-a516-7b717106c208 tempest-ServerActionsTestOtherA-916478349 tempest-ServerActionsTestOtherA-916478349-project-member] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.017s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-f4f9d5a1-f52d-43d1-98cc-40453e479a0e req-6b000124-8664-44c8-abdd-fad211b80eca service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:51:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f4f9d5a1-f52d-43d1-98cc-40453e479a0e req-6b000124-8664-44c8-abdd-fad211b80eca service nova] Acquiring lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:51:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f4f9d5a1-f52d-43d1-98cc-40453e479a0e req-6b000124-8664-44c8-abdd-fad211b80eca service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:51:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f4f9d5a1-f52d-43d1-98cc-40453e479a0e req-6b000124-8664-44c8-abdd-fad211b80eca service nova] Lock "ee3b2f60-0756-4d77-97ac-11fa0c456c1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:51:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-f4f9d5a1-f52d-43d1-98cc-40453e479a0e req-6b000124-8664-44c8-abdd-fad211b80eca service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] No waiting events found dispatching network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:51:57 user nova-compute[73029]: WARNING nova.compute.manager [req-f4f9d5a1-f52d-43d1-98cc-40453e479a0e req-6b000124-8664-44c8-abdd-fad211b80eca service nova] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Received unexpected event network-vif-plugged-756092b1-bc75-4163-a66c-ecaff9bcb39d for instance with vm_state deleted and task_state None.
Aug 10 00:52:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 6138a253-2316-4468-b8f9-9268b1b4ded1 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 1c23f226-a16a-4158-bac9-b9d78381fb5c {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "34141f58-5c62-4245-bd2a-06d4e4518529" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "34141f58-5c62-4245-bd2a-06d4e4518529" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628715.6509168, ee3b2f60-0756-4d77-97ac-11fa0c456c1f => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:52:10 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] VM Stopped (Lifecycle Event)
Aug 10 00:52:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2a15fdba-d993-452c-bc4b-669c0aff1bdc None None] [instance: ee3b2f60-0756-4d77-97ac-11fa0c456c1f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:52:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:20 user nova-compute[73029]: INFO nova.compute.manager [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Terminating instance
Aug 10 00:52:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-c6c930e7-810d-4fc3-aece-0be411f40bb1 req-84e06af1-9408-475d-9965-06dec2bcc447 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-unplugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c6c930e7-810d-4fc3-aece-0be411f40bb1 req-84e06af1-9408-475d-9965-06dec2bcc447 service nova] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c6c930e7-810d-4fc3-aece-0be411f40bb1 req-84e06af1-9408-475d-9965-06dec2bcc447 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c6c930e7-810d-4fc3-aece-0be411f40bb1 req-84e06af1-9408-475d-9965-06dec2bcc447 service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-c6c930e7-810d-4fc3-aece-0be411f40bb1 req-84e06af1-9408-475d-9965-06dec2bcc447 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] No waiting events found dispatching network-vif-unplugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:52:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-c6c930e7-810d-4fc3-aece-0be411f40bb1 req-84e06af1-9408-475d-9965-06dec2bcc447 service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-unplugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:52:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Instance destroyed successfully.
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lazy-loading 'resources' on Instance uuid 6138a253-2316-4468-b8f9-9268b1b4ded1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:47:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-199595920',display_name='tempest-TestMinimumBasicScenario-server-199595920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-199595920',id=27,image_ref='867a2fd6-5894-4597-bc89-2a4e567660fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3nPY4y1tXFz/1IDzjZWrun+N++XmsSFS4lk+ZcytxppraToHdYuIVhKBP9QJU4yfZs3BSfm7x3a/uIwYlUwL9r/ejn0Q4GSSdFaoH0wJpAefVKifWjrqIEbMOWtS3JFA==',key_name='tempest-TestMinimumBasicScenario-1630418481',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bdf72afe44346ebae59db7a6d57a787',ramdisk_id='',reservation_id='r-01xh3cqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='867a2fd6-5894-4597-bc89-2a4e567660fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-379185014',owner_user_name='tempest-TestMinimumBasicScenario-379185014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:49:36Z,user_data=None,user_id='e4fd570e277240d1b7c1b910a9289aad',uuid=6138a253-2316-4468-b8f9-9268b1b4ded1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converting VIF {"id": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "address": "fa:16:3e:f9:e9:33", "network": {"id": "c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1587385698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf72afe44346ebae59db7a6d57a787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2decd6-a5", "ovs_interfaceid": "ed2decd6-a50d-42f6-9fdf-c08b0e87db91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:e9:33,bridge_name='br-int',has_traffic_filtering=True,id=ed2decd6-a50d-42f6-9fdf-c08b0e87db91,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2decd6-a5') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG os_vif [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:e9:33,bridge_name='br-int',has_traffic_filtering=True,id=ed2decd6-a50d-42f6-9fdf-c08b0e87db91,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2decd6-a5') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped2decd6-a5, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:52:21 user nova-compute[73029]: INFO os_vif [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:e9:33,bridge_name='br-int',has_traffic_filtering=True,id=ed2decd6-a50d-42f6-9fdf-c08b0e87db91,network=Network(c0c52ce2-a2fc-4c88-9b64-b4d67b465bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2decd6-a5')
Aug 10 00:52:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Deleting instance files /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1_del
Aug 10 00:52:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Deletion of /opt/stack/data/nova/instances/6138a253-2316-4468-b8f9-9268b1b4ded1_del complete
Aug 10 00:52:21 user nova-compute[73029]: INFO nova.compute.manager [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 10 00:52:21 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-161ac587-8a13-49d7-8bda-0e6225a6b497 req-8d72d740-d51c-4717-9245-ec8be8f79c9c service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-deleted-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:52:21 user nova-compute[73029]: INFO nova.compute.manager [req-161ac587-8a13-49d7-8bda-0e6225a6b497 req-8d72d740-d51c-4717-9245-ec8be8f79c9c service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Neutron deleted interface ed2decd6-a50d-42f6-9fdf-c08b0e87db91; detaching it from the instance and deleting it from the info cache
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-161ac587-8a13-49d7-8bda-0e6225a6b497 req-8d72d740-d51c-4717-9245-ec8be8f79c9c service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:52:21 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Took 0.56 seconds to deallocate network for instance.
Aug 10 00:52:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-161ac587-8a13-49d7-8bda-0e6225a6b497 req-8d72d740-d51c-4717-9245-ec8be8f79c9c service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Detach interface failed, port_id=ed2decd6-a50d-42f6-9fdf-c08b0e87db91, reason: Instance 6138a253-2316-4468-b8f9-9268b1b4ded1 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:22 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Deleted allocations for instance 6138a253-2316-4468-b8f9-9268b1b4ded1
Aug 10 00:52:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a40a22d8-c5fd-4ab1-aba7-6077081ff11f tempest-TestMinimumBasicScenario-379185014 tempest-TestMinimumBasicScenario-379185014-project-member] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.799s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-29393a27-3be5-453d-980c-643996e076d8 req-4cd8c5ef-5e65-4f27-b8f7-67d308a3622e service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-29393a27-3be5-453d-980c-643996e076d8 req-4cd8c5ef-5e65-4f27-b8f7-67d308a3622e service nova] Acquiring lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-29393a27-3be5-453d-980c-643996e076d8 req-4cd8c5ef-5e65-4f27-b8f7-67d308a3622e service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-29393a27-3be5-453d-980c-643996e076d8 req-4cd8c5ef-5e65-4f27-b8f7-67d308a3622e service nova] Lock "6138a253-2316-4468-b8f9-9268b1b4ded1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-29393a27-3be5-453d-980c-643996e076d8 req-4cd8c5ef-5e65-4f27-b8f7-67d308a3622e service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] No waiting events found dispatching network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:52:22 user nova-compute[73029]: WARNING nova.compute.manager [req-29393a27-3be5-453d-980c-643996e076d8 req-4cd8c5ef-5e65-4f27-b8f7-67d308a3622e service nova] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Received unexpected event network-vif-plugged-ed2decd6-a50d-42f6-9fdf-c08b0e87db91 for instance with vm_state deleted and task_state None.
Aug 10 00:52:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:52:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 00:52:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:52:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:52:23 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:52:23 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:52:23 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updating instance_info_cache with network_info: [{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:52:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:52:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:52:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:52:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:52:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:52:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8257MB free_disk=25.27782440185547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 03d2b73d-de9a-4669-8d31-f3d38063faac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:52:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:52:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:52:34 user nova-compute[73029]: INFO nova.compute.manager [None req-0cd81a90-5cd7-40ae-949b-4c73fd4bac8d tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Unrescuing
Aug 10 00:52:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0cd81a90-5cd7-40ae-949b-4c73fd4bac8d tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:52:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0cd81a90-5cd7-40ae-949b-4c73fd4bac8d tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquired lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:52:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0cd81a90-5cd7-40ae-949b-4c73fd4bac8d tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:52:35 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0cd81a90-5cd7-40ae-949b-4c73fd4bac8d tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating instance_info_cache with network_info: [{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0cd81a90-5cd7-40ae-949b-4c73fd4bac8d tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Releasing lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:52:35 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0cd81a90-5cd7-40ae-949b-4c73fd4bac8d tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'flavor' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:52:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:35 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Instance destroyed successfully.
Aug 10 00:52:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-56ef058d-cf99-4fc2-9016-ca55a7b9a031 req-dff0ccb8-5d45-4de6-8c86-fa012b2c62e5 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-unplugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:52:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-56ef058d-cf99-4fc2-9016-ca55a7b9a031 req-dff0ccb8-5d45-4de6-8c86-fa012b2c62e5 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-56ef058d-cf99-4fc2-9016-ca55a7b9a031 req-dff0ccb8-5d45-4de6-8c86-fa012b2c62e5 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-56ef058d-cf99-4fc2-9016-ca55a7b9a031 req-dff0ccb8-5d45-4de6-8c86-fa012b2c62e5 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-56ef058d-cf99-4fc2-9016-ca55a7b9a031 req-dff0ccb8-5d45-4de6-8c86-fa012b2c62e5 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-unplugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:52:36 user nova-compute[73029]: WARNING nova.compute.manager [req-56ef058d-cf99-4fc2-9016-ca55a7b9a031 req-dff0ccb8-5d45-4de6-8c86-fa012b2c62e5 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-unplugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:52:36 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628741.3301277, 6138a253-2316-4468-b8f9-9268b1b4ded1 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:52:36 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] VM Stopped (Lifecycle Event)
Aug 10 00:52:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5ad8f236-97d8-45a4-80ed-ed215a1142d6 None None] [instance: 6138a253-2316-4468-b8f9-9268b1b4ded1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:52:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:52:38 user nova-compute[73029]: WARNING nova.compute.manager [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:52:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:52:38 user nova-compute[73029]: WARNING nova.compute.manager [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:52:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:52:38 user nova-compute[73029]: WARNING nova.compute.manager [req-4beb1d6f-fc39-4e6d-b7c4-d25fe7a9297d req-813be2b9-fa45-4195-8195-6e1fc4ebbe63 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:52:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 03d2b73d-de9a-4669-8d31-f3d38063faac due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:52:39 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628759.38398, 03d2b73d-de9a-4669-8d31-f3d38063faac => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:52:39 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] VM Resumed (Lifecycle Event)
Aug 10 00:52:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0cd81a90-5cd7-40ae-949b-4c73fd4bac8d tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:52:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:52:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:52:39 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 10 00:52:39 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628759.3880236, 03d2b73d-de9a-4669-8d31-f3d38063faac => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:52:39 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] VM Started (Lifecycle Event)
Aug 10 00:52:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:52:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:52:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:52:47 user nova-compute[73029]: INFO nova.compute.manager [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] instance snapshotting
Aug 10 00:52:47 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Beginning live snapshot process
Aug 10 00:52:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json -f qcow2 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json -f qcow2 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx9p_ya_9/75546771589a4f1c84d482c54792fcbb.delta 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx9p_ya_9/75546771589a4f1c84d482c54792fcbb.delta 1073741824" returned: 0 in 0.062s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:47 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 10 00:52:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:52:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 00:52:49 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 10 00:52:49 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 00:52:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx9p_ya_9/75546771589a4f1c84d482c54792fcbb.delta /opt/stack/data/nova/instances/snapshots/tmpx9p_ya_9/75546771589a4f1c84d482c54792fcbb {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx9p_ya_9/75546771589a4f1c84d482c54792fcbb.delta /opt/stack/data/nova/instances/snapshots/tmpx9p_ya_9/75546771589a4f1c84d482c54792fcbb" returned: 0 in 0.545s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:49 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Snapshot extracted, beginning image upload
Aug 10 00:52:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Snapshot image upload complete
Aug 10 00:52:52 user nova-compute[73029]: INFO nova.compute.manager [None req-a8746ee3-0a83-4138-b1fa-2fbcd138989c tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Took 5.90 seconds to snapshot the instance on the hypervisor.
Aug 10 00:52:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:52:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:52:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:52:59 user nova-compute[73029]: INFO nova.compute.claims [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Claim successful on node user
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:52:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.policy [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4e4682fd39448e5b08386bec3de4b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0830285a49344db872f7606cc837795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:52:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Creating image(s)
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "/opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "/opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.161s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:52:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk 1073741824" returned: 0 in 0.056s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Cannot resize image /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lazy-loading 'migration_context' on Instance uuid a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Successfully created port: 032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Ensure instance console log exists: /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Successfully updated port: 032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "refresh_cache-a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquired lock "refresh_cache-a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-44a74c46-abe9-463c-9611-940868027dd9 req-37cf2a29-8f49-4984-a7b2-e65ee26e54d6 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received event network-changed-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-44a74c46-abe9-463c-9611-940868027dd9 req-37cf2a29-8f49-4984-a7b2-e65ee26e54d6 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Refreshing instance network info cache due to event network-changed-032db619-2c68-440b-8a21-5acd16a08c3f. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-44a74c46-abe9-463c-9611-940868027dd9 req-37cf2a29-8f49-4984-a7b2-e65ee26e54d6 service nova] Acquiring lock "refresh_cache-a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Updating instance_info_cache with network_info: [{"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Releasing lock "refresh_cache-a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Instance network_info: |[{"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-44a74c46-abe9-463c-9611-940868027dd9 req-37cf2a29-8f49-4984-a7b2-e65ee26e54d6 service nova] Acquired lock "refresh_cache-a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.network.neutron [req-44a74c46-abe9-463c-9611-940868027dd9 req-37cf2a29-8f49-4984-a7b2-e65ee26e54d6 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Refreshing network info cache for port 032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Start _get_guest_xml network_info=[{"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:53:01 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:53:01 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1189812315',display_name='tempest-ServersNegativeTestJSON-server-1189812315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1189812315',id=30,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0830285a49344db872f7606cc837795',ramdisk_id='',reservation_id='r-8emnj17g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-533946204',owner_user_name='tempest-ServersNegativeTestJSON-533946204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:53:00Z,user_data=None,user_id='e4e4682fd39448e5b08386bec3de4b22',uuid=a3c67cb8-78f9-4664-8c86-cc429eb0b4f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converting VIF {"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:45:88,bridge_name='br-int',has_traffic_filtering=True,id=032db619-2c68-440b-8a21-5acd16a08c3f,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032db619-2c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lazy-loading 'pci_devices' on Instance uuid a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:53:01 user nova-compute[73029]:   <uuid>a3c67cb8-78f9-4664-8c86-cc429eb0b4f3</uuid>
Aug 10 00:53:01 user nova-compute[73029]:   <name>instance-0000001e</name>
Aug 10 00:53:01 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:53:01 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:53:01 user nova-compute[73029]:   <metadata>
Aug 10 00:53:01 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:53:01 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:53:01 user nova-compute[73029]:       <nova:name>tempest-ServersNegativeTestJSON-server-1189812315</nova:name>
Aug 10 00:53:01 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:53:01</nova:creationTime>
Aug 10 00:53:01 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:53:01 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:53:01 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:53:01 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:53:01 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:53:01 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:53:01 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:53:01 user nova-compute[73029]:       <nova:owner>
Aug 10 00:53:01 user nova-compute[73029]:         <nova:user uuid="e4e4682fd39448e5b08386bec3de4b22">tempest-ServersNegativeTestJSON-533946204-project-member</nova:user>
Aug 10 00:53:01 user nova-compute[73029]:         <nova:project uuid="a0830285a49344db872f7606cc837795">tempest-ServersNegativeTestJSON-533946204</nova:project>
Aug 10 00:53:01 user nova-compute[73029]:       </nova:owner>
Aug 10 00:53:01 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:53:01 user nova-compute[73029]:       <nova:ports>
Aug 10 00:53:01 user nova-compute[73029]:         <nova:port uuid="032db619-2c68-440b-8a21-5acd16a08c3f">
Aug 10 00:53:01 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 10 00:53:01 user nova-compute[73029]:         </nova:port>
Aug 10 00:53:01 user nova-compute[73029]:       </nova:ports>
Aug 10 00:53:01 user nova-compute[73029]:     </nova:instance>
Aug 10 00:53:01 user nova-compute[73029]:   </metadata>
Aug 10 00:53:01 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:53:01 user nova-compute[73029]:     <system>
Aug 10 00:53:01 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:53:01 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:53:01 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:53:01 user nova-compute[73029]:       <entry name="serial">a3c67cb8-78f9-4664-8c86-cc429eb0b4f3</entry>
Aug 10 00:53:01 user nova-compute[73029]:       <entry name="uuid">a3c67cb8-78f9-4664-8c86-cc429eb0b4f3</entry>
Aug 10 00:53:01 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:53:01 user nova-compute[73029]:     </system>
Aug 10 00:53:01 user nova-compute[73029]:   </sysinfo>
Aug 10 00:53:01 user nova-compute[73029]:   <os>
Aug 10 00:53:01 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:53:01 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:53:01 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:53:01 user nova-compute[73029]:   </os>
Aug 10 00:53:01 user nova-compute[73029]:   <features>
Aug 10 00:53:01 user nova-compute[73029]:     <acpi/>
Aug 10 00:53:01 user nova-compute[73029]:     <apic/>
Aug 10 00:53:01 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:53:01 user nova-compute[73029]:   </features>
Aug 10 00:53:01 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:53:01 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:53:01 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:53:01 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:53:01 user nova-compute[73029]:   </clock>
Aug 10 00:53:01 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:53:01 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:53:01 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:53:01 user nova-compute[73029]:   </cpu>
Aug 10 00:53:01 user nova-compute[73029]:   <devices>
Aug 10 00:53:01 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:53:01 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:53:01 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk"/>
Aug 10 00:53:01 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:53:01 user nova-compute[73029]:     </disk>
Aug 10 00:53:01 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:53:01 user nova-compute[73029]:       <mac address="fa:16:3e:fa:45:88"/>
Aug 10 00:53:01 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:53:01 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:53:01 user nova-compute[73029]:       <target dev="tap032db619-2c"/>
Aug 10 00:53:01 user nova-compute[73029]:     </interface>
Aug 10 00:53:01 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:53:01 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/console.log" append="off"/>
Aug 10 00:53:01 user nova-compute[73029]:     </serial>
Aug 10 00:53:01 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:53:01 user nova-compute[73029]:     <video>
Aug 10 00:53:01 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:53:01 user nova-compute[73029]:     </video>
Aug 10 00:53:01 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:53:01 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:53:01 user nova-compute[73029]:     </rng>
Aug 10 00:53:01 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:53:01 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:53:01 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:53:01 user nova-compute[73029]:     </memballoon>
Aug 10 00:53:01 user nova-compute[73029]:   </devices>
Aug 10 00:53:01 user nova-compute[73029]: </domain>
Aug 10 00:53:01 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1189812315',display_name='tempest-ServersNegativeTestJSON-server-1189812315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1189812315',id=30,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0830285a49344db872f7606cc837795',ramdisk_id='',reservation_id='r-8emnj17g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-533946204',owner_user_name='tempest-ServersNegativeTestJSON-533946204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:53:00Z,user_data=None,user_id='e4e4682fd39448e5b08386bec3de4b22',uuid=a3c67cb8-78f9-4664-8c86-cc429eb0b4f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converting VIF {"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:45:88,bridge_name='br-int',has_traffic_filtering=True,id=032db619-2c68-440b-8a21-5acd16a08c3f,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032db619-2c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG os_vif [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:45:88,bridge_name='br-int',has_traffic_filtering=True,id=032db619-2c68-440b-8a21-5acd16a08c3f,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032db619-2c') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap032db619-2c, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap032db619-2c, col_values=(('external_ids', {'iface-id': '032db619-2c68-440b-8a21-5acd16a08c3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:45:88', 'vm-uuid': 'a3c67cb8-78f9-4664-8c86-cc429eb0b4f3'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:01 user nova-compute[73029]: INFO os_vif [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:45:88,bridge_name='br-int',has_traffic_filtering=True,id=032db619-2c68-440b-8a21-5acd16a08c3f,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032db619-2c')
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:53:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] No VIF found with MAC fa:16:3e:fa:45:88, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:53:02 user nova-compute[73029]: DEBUG nova.network.neutron [req-44a74c46-abe9-463c-9611-940868027dd9 req-37cf2a29-8f49-4984-a7b2-e65ee26e54d6 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Updated VIF entry in instance network info cache for port 032db619-2c68-440b-8a21-5acd16a08c3f. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:53:02 user nova-compute[73029]: DEBUG nova.network.neutron [req-44a74c46-abe9-463c-9611-940868027dd9 req-37cf2a29-8f49-4984-a7b2-e65ee26e54d6 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Updating instance_info_cache with network_info: [{"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:53:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-44a74c46-abe9-463c-9611-940868027dd9 req-37cf2a29-8f49-4984-a7b2-e65ee26e54d6 service nova] Releasing lock "refresh_cache-a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:53:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:03 user nova-compute[73029]: DEBUG nova.compute.manager [req-7c40dcd1-7f1a-4787-83b5-38605ae2d781 req-3b85ae25-30fc-454e-b681-2ccaeb030008 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received event network-vif-plugged-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:53:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7c40dcd1-7f1a-4787-83b5-38605ae2d781 req-3b85ae25-30fc-454e-b681-2ccaeb030008 service nova] Acquiring lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7c40dcd1-7f1a-4787-83b5-38605ae2d781 req-3b85ae25-30fc-454e-b681-2ccaeb030008 service nova] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7c40dcd1-7f1a-4787-83b5-38605ae2d781 req-3b85ae25-30fc-454e-b681-2ccaeb030008 service nova] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:03 user nova-compute[73029]: DEBUG nova.compute.manager [req-7c40dcd1-7f1a-4787-83b5-38605ae2d781 req-3b85ae25-30fc-454e-b681-2ccaeb030008 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] No waiting events found dispatching network-vif-plugged-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:53:03 user nova-compute[73029]: WARNING nova.compute.manager [req-7c40dcd1-7f1a-4787-83b5-38605ae2d781 req-3b85ae25-30fc-454e-b681-2ccaeb030008 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received unexpected event network-vif-plugged-032db619-2c68-440b-8a21-5acd16a08c3f for instance with vm_state building and task_state spawning.
Aug 10 00:53:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628785.358404, a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:53:05 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] VM Resumed (Lifecycle Event)
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:53:05 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Instance spawned successfully.
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-b67dc49f-71ce-4ac3-9568-ad5b4e766785 req-0069e295-8066-4a97-b5b6-643b14cb3274 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received event network-vif-plugged-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b67dc49f-71ce-4ac3-9568-ad5b4e766785 req-0069e295-8066-4a97-b5b6-643b14cb3274 service nova] Acquiring lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b67dc49f-71ce-4ac3-9568-ad5b4e766785 req-0069e295-8066-4a97-b5b6-643b14cb3274 service nova] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b67dc49f-71ce-4ac3-9568-ad5b4e766785 req-0069e295-8066-4a97-b5b6-643b14cb3274 service nova] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-b67dc49f-71ce-4ac3-9568-ad5b4e766785 req-0069e295-8066-4a97-b5b6-643b14cb3274 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] No waiting events found dispatching network-vif-plugged-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:53:05 user nova-compute[73029]: WARNING nova.compute.manager [req-b67dc49f-71ce-4ac3-9568-ad5b4e766785 req-0069e295-8066-4a97-b5b6-643b14cb3274 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received unexpected event network-vif-plugged-032db619-2c68-440b-8a21-5acd16a08c3f for instance with vm_state building and task_state spawning.
Aug 10 00:53:05 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628785.365205, a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:53:05 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] VM Started (Lifecycle Event)
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:53:05 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:53:05 user nova-compute[73029]: INFO nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 10 00:53:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:53:05 user nova-compute[73029]: INFO nova.compute.manager [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Took 6.64 seconds to build instance.
Aug 10 00:53:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8fb3d7bc-faae-43ee-80eb-6c9f7573d534 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.842s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:53:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:53:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:53:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:53:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:25 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updating instance_info_cache with network_info: [{"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:53:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-34141f58-5c62-4245-bd2a-06d4e4518529" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:53:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:53:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:31 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:53:31 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8134MB free_disk=25.22756576538086GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 03d2b73d-de9a-4669-8d31-f3d38063faac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:53:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:53:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:53:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:53:38 user nova-compute[73029]: INFO nova.compute.claims [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Claim successful on node user
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.network.neutron [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:53:38 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.policy [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f7d59697076467684cf0116c8f4bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e736dbfadf984fa28758873dea55945c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:53:38 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Creating image(s)
Aug 10 00:53:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "/opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "/opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk 1073741824" returned: 0 in 0.056s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG nova.network.neutron [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Successfully created port: 4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Cannot resize image /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'migration_context' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Ensure instance console log exists: /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.network.neutron [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Successfully updated port: 4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquired lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.network.neutron [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-e557b22f-9167-4b46-99d9-198937e8d5aa req-ad17bc1f-8c20-4d09-b4d0-76f6ecc43179 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received event network-changed-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-e557b22f-9167-4b46-99d9-198937e8d5aa req-ad17bc1f-8c20-4d09-b4d0-76f6ecc43179 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Refreshing instance network info cache due to event network-changed-4ee4e715-c241-40fe-80d4-f848e01a8693. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e557b22f-9167-4b46-99d9-198937e8d5aa req-ad17bc1f-8c20-4d09-b4d0-76f6ecc43179 service nova] Acquiring lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.network.neutron [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.network.neutron [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updating instance_info_cache with network_info: [{"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Releasing lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Instance network_info: |[{"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e557b22f-9167-4b46-99d9-198937e8d5aa req-ad17bc1f-8c20-4d09-b4d0-76f6ecc43179 service nova] Acquired lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.network.neutron [req-e557b22f-9167-4b46-99d9-198937e8d5aa req-ad17bc1f-8c20-4d09-b4d0-76f6ecc43179 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Refreshing network info cache for port 4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Start _get_guest_xml network_info=[{"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:53:40 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:53:40 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1438349175',display_name='tempest-SnapshotDataIntegrityTests-server-1438349175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1438349175',id=31,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkNvOEsePUuh3FFHcoNYIYmLJWXjb4VsBU7H1I6DDfFjKhOopjkr6/DD2S3K/1R3m13xWpug18qdskbiwzLoumv3mBqEkKouMJ3EjdttXnXLz55iaf/wzaTygNyVBQczg==',key_name='tempest-keypair-1301247432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e736dbfadf984fa28758873dea55945c',ramdisk_id='',reservation_id='r-23il1h9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-888070448',owner_user_name='tempest-SnapshotDataIntegrityTests-888070448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f7d59697076467684cf0116c8f4bb79',uuid=cd1ef428-2411-4cb8-bccd-7741e05e1a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Converting VIF {"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=4ee4e715-c241-40fe-80d4-f848e01a8693,network=Network(29959670-d800-429b-ab07-e231fc3821d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee4e715-c2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'pci_devices' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:53:40 user nova-compute[73029]:   <uuid>cd1ef428-2411-4cb8-bccd-7741e05e1a50</uuid>
Aug 10 00:53:40 user nova-compute[73029]:   <name>instance-0000001f</name>
Aug 10 00:53:40 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:53:40 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:53:40 user nova-compute[73029]:   <metadata>
Aug 10 00:53:40 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:53:40 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:53:40 user nova-compute[73029]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1438349175</nova:name>
Aug 10 00:53:40 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:53:40</nova:creationTime>
Aug 10 00:53:40 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:53:40 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:53:40 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:53:40 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:53:40 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:53:40 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:53:40 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:53:40 user nova-compute[73029]:       <nova:owner>
Aug 10 00:53:40 user nova-compute[73029]:         <nova:user uuid="6f7d59697076467684cf0116c8f4bb79">tempest-SnapshotDataIntegrityTests-888070448-project-member</nova:user>
Aug 10 00:53:40 user nova-compute[73029]:         <nova:project uuid="e736dbfadf984fa28758873dea55945c">tempest-SnapshotDataIntegrityTests-888070448</nova:project>
Aug 10 00:53:40 user nova-compute[73029]:       </nova:owner>
Aug 10 00:53:40 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:53:40 user nova-compute[73029]:       <nova:ports>
Aug 10 00:53:40 user nova-compute[73029]:         <nova:port uuid="4ee4e715-c241-40fe-80d4-f848e01a8693">
Aug 10 00:53:40 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 00:53:40 user nova-compute[73029]:         </nova:port>
Aug 10 00:53:40 user nova-compute[73029]:       </nova:ports>
Aug 10 00:53:40 user nova-compute[73029]:     </nova:instance>
Aug 10 00:53:40 user nova-compute[73029]:   </metadata>
Aug 10 00:53:40 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:53:40 user nova-compute[73029]:     <system>
Aug 10 00:53:40 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:53:40 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:53:40 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:53:40 user nova-compute[73029]:       <entry name="serial">cd1ef428-2411-4cb8-bccd-7741e05e1a50</entry>
Aug 10 00:53:40 user nova-compute[73029]:       <entry name="uuid">cd1ef428-2411-4cb8-bccd-7741e05e1a50</entry>
Aug 10 00:53:40 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:53:40 user nova-compute[73029]:     </system>
Aug 10 00:53:40 user nova-compute[73029]:   </sysinfo>
Aug 10 00:53:40 user nova-compute[73029]:   <os>
Aug 10 00:53:40 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:53:40 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:53:40 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:53:40 user nova-compute[73029]:   </os>
Aug 10 00:53:40 user nova-compute[73029]:   <features>
Aug 10 00:53:40 user nova-compute[73029]:     <acpi/>
Aug 10 00:53:40 user nova-compute[73029]:     <apic/>
Aug 10 00:53:40 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:53:40 user nova-compute[73029]:   </features>
Aug 10 00:53:40 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:53:40 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:53:40 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:53:40 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:53:40 user nova-compute[73029]:   </clock>
Aug 10 00:53:40 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:53:40 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:53:40 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:53:40 user nova-compute[73029]:   </cpu>
Aug 10 00:53:40 user nova-compute[73029]:   <devices>
Aug 10 00:53:40 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:53:40 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:53:40 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk"/>
Aug 10 00:53:40 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:53:40 user nova-compute[73029]:     </disk>
Aug 10 00:53:40 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:53:40 user nova-compute[73029]:       <mac address="fa:16:3e:fd:b9:fa"/>
Aug 10 00:53:40 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:53:40 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:53:40 user nova-compute[73029]:       <target dev="tap4ee4e715-c2"/>
Aug 10 00:53:40 user nova-compute[73029]:     </interface>
Aug 10 00:53:40 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:53:40 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/console.log" append="off"/>
Aug 10 00:53:40 user nova-compute[73029]:     </serial>
Aug 10 00:53:40 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:53:40 user nova-compute[73029]:     <video>
Aug 10 00:53:40 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:53:40 user nova-compute[73029]:     </video>
Aug 10 00:53:40 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:53:40 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:53:40 user nova-compute[73029]:     </rng>
Aug 10 00:53:40 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:53:40 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:53:40 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:53:40 user nova-compute[73029]:     </memballoon>
Aug 10 00:53:40 user nova-compute[73029]:   </devices>
Aug 10 00:53:40 user nova-compute[73029]: </domain>
Aug 10 00:53:40 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1438349175',display_name='tempest-SnapshotDataIntegrityTests-server-1438349175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1438349175',id=31,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkNvOEsePUuh3FFHcoNYIYmLJWXjb4VsBU7H1I6DDfFjKhOopjkr6/DD2S3K/1R3m13xWpug18qdskbiwzLoumv3mBqEkKouMJ3EjdttXnXLz55iaf/wzaTygNyVBQczg==',key_name='tempest-keypair-1301247432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e736dbfadf984fa28758873dea55945c',ramdisk_id='',reservation_id='r-23il1h9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-888070448',owner_user_name='tempest-SnapshotDataIntegrityTests-888070448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f7d59697076467684cf0116c8f4bb79',uuid=cd1ef428-2411-4cb8-bccd-7741e05e1a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Converting VIF {"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=4ee4e715-c241-40fe-80d4-f848e01a8693,network=Network(29959670-d800-429b-ab07-e231fc3821d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee4e715-c2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG os_vif [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=4ee4e715-c241-40fe-80d4-f848e01a8693,network=Network(29959670-d800-429b-ab07-e231fc3821d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee4e715-c2') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ee4e715-c2, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ee4e715-c2, col_values=(('external_ids', {'iface-id': '4ee4e715-c241-40fe-80d4-f848e01a8693', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:b9:fa', 'vm-uuid': 'cd1ef428-2411-4cb8-bccd-7741e05e1a50'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:40 user nova-compute[73029]: INFO os_vif [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=4ee4e715-c241-40fe-80d4-f848e01a8693,network=Network(29959670-d800-429b-ab07-e231fc3821d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee4e715-c2')
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:53:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No VIF found with MAC fa:16:3e:fd:b9:fa, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:53:41 user nova-compute[73029]: DEBUG nova.network.neutron [req-e557b22f-9167-4b46-99d9-198937e8d5aa req-ad17bc1f-8c20-4d09-b4d0-76f6ecc43179 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updated VIF entry in instance network info cache for port 4ee4e715-c241-40fe-80d4-f848e01a8693. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:53:41 user nova-compute[73029]: DEBUG nova.network.neutron [req-e557b22f-9167-4b46-99d9-198937e8d5aa req-ad17bc1f-8c20-4d09-b4d0-76f6ecc43179 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updating instance_info_cache with network_info: [{"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:53:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e557b22f-9167-4b46-99d9-198937e8d5aa req-ad17bc1f-8c20-4d09-b4d0-76f6ecc43179 service nova] Releasing lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-f6b38f57-89c8-4597-81bf-d81db0f93e2e req-813e5d32-4a54-485e-ab41-1e0e450a6fdf service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received event network-vif-plugged-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f6b38f57-89c8-4597-81bf-d81db0f93e2e req-813e5d32-4a54-485e-ab41-1e0e450a6fdf service nova] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f6b38f57-89c8-4597-81bf-d81db0f93e2e req-813e5d32-4a54-485e-ab41-1e0e450a6fdf service nova] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f6b38f57-89c8-4597-81bf-d81db0f93e2e req-813e5d32-4a54-485e-ab41-1e0e450a6fdf service nova] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-f6b38f57-89c8-4597-81bf-d81db0f93e2e req-813e5d32-4a54-485e-ab41-1e0e450a6fdf service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] No waiting events found dispatching network-vif-plugged-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:53:42 user nova-compute[73029]: WARNING nova.compute.manager [req-f6b38f57-89c8-4597-81bf-d81db0f93e2e req-813e5d32-4a54-485e-ab41-1e0e450a6fdf service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received unexpected event network-vif-plugged-4ee4e715-c241-40fe-80d4-f848e01a8693 for instance with vm_state building and task_state spawning.
Aug 10 00:53:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628824.4683044, cd1ef428-2411-4cb8-bccd-7741e05e1a50 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:53:44 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] VM Resumed (Lifecycle Event)
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:53:44 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Instance spawned successfully.
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:53:44 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628824.4728742, cd1ef428-2411-4cb8-bccd-7741e05e1a50 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:53:44 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] VM Started (Lifecycle Event)
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:53:44 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-5b165191-0135-4699-b6e8-b8b1ed1c1ab1 req-3b6d7789-e4fd-490b-aabb-2e060a516ba6 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received event network-vif-plugged-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5b165191-0135-4699-b6e8-b8b1ed1c1ab1 req-3b6d7789-e4fd-490b-aabb-2e060a516ba6 service nova] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5b165191-0135-4699-b6e8-b8b1ed1c1ab1 req-3b6d7789-e4fd-490b-aabb-2e060a516ba6 service nova] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5b165191-0135-4699-b6e8-b8b1ed1c1ab1 req-3b6d7789-e4fd-490b-aabb-2e060a516ba6 service nova] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-5b165191-0135-4699-b6e8-b8b1ed1c1ab1 req-3b6d7789-e4fd-490b-aabb-2e060a516ba6 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] No waiting events found dispatching network-vif-plugged-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:53:44 user nova-compute[73029]: WARNING nova.compute.manager [req-5b165191-0135-4699-b6e8-b8b1ed1c1ab1 req-3b6d7789-e4fd-490b-aabb-2e060a516ba6 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received unexpected event network-vif-plugged-4ee4e715-c241-40fe-80d4-f848e01a8693 for instance with vm_state building and task_state spawning.
Aug 10 00:53:44 user nova-compute[73029]: INFO nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 10 00:53:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:53:44 user nova-compute[73029]: INFO nova.compute.manager [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Took 6.32 seconds to build instance.
Aug 10 00:53:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d0c35d44-be02-4853-9a0a-a90e98e071a3 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.424s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:53:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:53:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:53:54 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:53:54 user nova-compute[73029]: INFO nova.compute.claims [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Claim successful on node user
Aug 10 00:53:55 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:53:55 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:53:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:53:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:53:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:53:55 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:53:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:53:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:53:55 user nova-compute[73029]: INFO nova.virt.block_device [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Booting with blank volume at /dev/vda
Aug 10 00:53:55 user nova-compute[73029]: DEBUG nova.policy [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d34a91746034f349b7eeccfd372f21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39027fdade2f41048db7d3855f3197cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:53:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:53:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Successfully created port: 858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Successfully updated port: 858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquired lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-21314d95-9890-4527-8ed3-51d1cde5db44 req-e6ade5ed-4a91-4cf5-9c25-1bf743671eff service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-changed-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-21314d95-9890-4527-8ed3-51d1cde5db44 req-e6ade5ed-4a91-4cf5-9c25-1bf743671eff service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Refreshing instance network info cache due to event network-changed-858ac141-686d-4e33-9ee4-f90c5d43e834. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-21314d95-9890-4527-8ed3-51d1cde5db44 req-e6ade5ed-4a91-4cf5-9c25-1bf743671eff service nova] Acquiring lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updating instance_info_cache with network_info: [{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Releasing lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Instance network_info: |[{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-21314d95-9890-4527-8ed3-51d1cde5db44 req-e6ade5ed-4a91-4cf5-9c25-1bf743671eff service nova] Acquired lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:53:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-21314d95-9890-4527-8ed3-51d1cde5db44 req-e6ade5ed-4a91-4cf5-9c25-1bf743671eff service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Refreshing network info cache for port 858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:53:58 user nova-compute[73029]: DEBUG nova.network.neutron [req-21314d95-9890-4527-8ed3-51d1cde5db44 req-e6ade5ed-4a91-4cf5-9c25-1bf743671eff service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updated VIF entry in instance network info cache for port 858ac141-686d-4e33-9ee4-f90c5d43e834. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:53:58 user nova-compute[73029]: DEBUG nova.network.neutron [req-21314d95-9890-4527-8ed3-51d1cde5db44 req-e6ade5ed-4a91-4cf5-9c25-1bf743671eff service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updating instance_info_cache with network_info: [{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:53:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-21314d95-9890-4527-8ed3-51d1cde5db44 req-e6ade5ed-4a91-4cf5-9c25-1bf743671eff service nova] Releasing lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:54:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG os_brick.utils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30cd7a3-15f9-409b-8dfe-1b540417bb97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[055353cc-c4b6-4a3b-8ee6-10e2a1d0a281]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f5b3cb-90e0-4c87-9815-53cbf28f0f5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fee4aed-a08a-423e-bb2e-9a90343e161f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:54:01 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:54:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d13a48e-e168-4f06-8598-50455655e550]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG os_brick.utils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:54:01 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updating existing volume attachment record: 64cc763f-47b6-4d18-9776-a5e089a63ce1 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:54:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:54:09 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Creating image(s)
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Ensure instance console log exists: /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Start _get_guest_xml network_info=[{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '64cc763f-47b6-4d18-9776-a5e089a63ce1', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupvtCwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d6ce28c-39f0-432c-bfe3-a5891fb69021', 'attached_at': '', 'detached_at': '', 'volume_id': 'b657d186-0636-4d90-a0f4-a03cc37eb04e', 'serial': 'b657d186-0636-4d90-a0f4-a03cc37eb04e'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:54:09 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:54:09 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupvtCwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:54:09 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:54:09 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:54:09 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab2c646-8255-4bd2-9ffc-0f7e67c72173]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:54:09 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae16ba97-bcb0-4d0c-8009-fa2c5693950a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e] added
Aug 10 00:54:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[564bb83a-cfd3-41bc-881a-175605ce5da8]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[365a887e-aa2e-4544-8c8a-642418580cb8]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DupvtCwZ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DupvtCwZ" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb9e13-6a21-48ca-8a8b-4fb8bf64d3f7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DupvtCwZ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c80574c-1f65-46a4-a458-370755b37bda]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af718c-d76a-43b7-8abc-f0157d984c8b]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:54:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:54:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[428f235d-9219-450a-9456-bcd76d5ca391]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e, portal: 172.16.0.220,3260]
Aug 10 00:54:09 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e, portal: 172.16.0.220,3260] successful.
Aug 10 00:54:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[70546b6e-85fa-4101-98ae-3de839133a03]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f9cf4a-d168-4259-9456-cfe50a826b14]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:54:09 user nova-compute[73029]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:54:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:54:09 user nova-compute[73029]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:54:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed2f7ec-f296-4d06-9954-ee0e4b1ef571]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupvtCwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26638643139363365', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638643139363365', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-831966501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-831966501',id=32,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-nr8n9cjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:53:55Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=3d6ce28c-39f0-432c-bfe3-a5891fb69021,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cb:18,bridge_name='br-int',has_traffic_filtering=True,id=858ac141-686d-4e33-9ee4-f90c5d43e834,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap858ac141-68') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:54:10 user nova-compute[73029]:   <uuid>3d6ce28c-39f0-432c-bfe3-a5891fb69021</uuid>
Aug 10 00:54:10 user nova-compute[73029]:   <name>instance-00000020</name>
Aug 10 00:54:10 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:54:10 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:54:10 user nova-compute[73029]:   <metadata>
Aug 10 00:54:10 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:54:10 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:54:10 user nova-compute[73029]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-831966501</nova:name>
Aug 10 00:54:10 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:54:09</nova:creationTime>
Aug 10 00:54:10 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:54:10 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:54:10 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:54:10 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:54:10 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:54:10 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:54:10 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:54:10 user nova-compute[73029]:       <nova:owner>
Aug 10 00:54:10 user nova-compute[73029]:         <nova:user uuid="6d34a91746034f349b7eeccfd372f21a">tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member</nova:user>
Aug 10 00:54:10 user nova-compute[73029]:         <nova:project uuid="39027fdade2f41048db7d3855f3197cc">tempest-ServerBootFromVolumeStableRescueTest-1463443327</nova:project>
Aug 10 00:54:10 user nova-compute[73029]:       </nova:owner>
Aug 10 00:54:10 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:54:10 user nova-compute[73029]:       <nova:ports>
Aug 10 00:54:10 user nova-compute[73029]:         <nova:port uuid="858ac141-686d-4e33-9ee4-f90c5d43e834">
Aug 10 00:54:10 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 10 00:54:10 user nova-compute[73029]:         </nova:port>
Aug 10 00:54:10 user nova-compute[73029]:       </nova:ports>
Aug 10 00:54:10 user nova-compute[73029]:     </nova:instance>
Aug 10 00:54:10 user nova-compute[73029]:   </metadata>
Aug 10 00:54:10 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:54:10 user nova-compute[73029]:     <system>
Aug 10 00:54:10 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:54:10 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:54:10 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:54:10 user nova-compute[73029]:       <entry name="serial">3d6ce28c-39f0-432c-bfe3-a5891fb69021</entry>
Aug 10 00:54:10 user nova-compute[73029]:       <entry name="uuid">3d6ce28c-39f0-432c-bfe3-a5891fb69021</entry>
Aug 10 00:54:10 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:54:10 user nova-compute[73029]:     </system>
Aug 10 00:54:10 user nova-compute[73029]:   </sysinfo>
Aug 10 00:54:10 user nova-compute[73029]:   <os>
Aug 10 00:54:10 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:54:10 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:54:10 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:54:10 user nova-compute[73029]:   </os>
Aug 10 00:54:10 user nova-compute[73029]:   <features>
Aug 10 00:54:10 user nova-compute[73029]:     <acpi/>
Aug 10 00:54:10 user nova-compute[73029]:     <apic/>
Aug 10 00:54:10 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:54:10 user nova-compute[73029]:   </features>
Aug 10 00:54:10 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:54:10 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:54:10 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:54:10 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:54:10 user nova-compute[73029]:   </clock>
Aug 10 00:54:10 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:54:10 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:54:10 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:54:10 user nova-compute[73029]:   </cpu>
Aug 10 00:54:10 user nova-compute[73029]:   <devices>
Aug 10 00:54:10 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:54:10 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:54:10 user nova-compute[73029]:       <source dev="/dev/sdc"/>
Aug 10 00:54:10 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:54:10 user nova-compute[73029]:       <serial>b657d186-0636-4d90-a0f4-a03cc37eb04e</serial>
Aug 10 00:54:10 user nova-compute[73029]:     </disk>
Aug 10 00:54:10 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:54:10 user nova-compute[73029]:       <mac address="fa:16:3e:d8:cb:18"/>
Aug 10 00:54:10 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:54:10 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:54:10 user nova-compute[73029]:       <target dev="tap858ac141-68"/>
Aug 10 00:54:10 user nova-compute[73029]:     </interface>
Aug 10 00:54:10 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:54:10 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/console.log" append="off"/>
Aug 10 00:54:10 user nova-compute[73029]:     </serial>
Aug 10 00:54:10 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:54:10 user nova-compute[73029]:     <video>
Aug 10 00:54:10 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:54:10 user nova-compute[73029]:     </video>
Aug 10 00:54:10 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:54:10 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:54:10 user nova-compute[73029]:     </rng>
Aug 10 00:54:10 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:54:10 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:54:10 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:54:10 user nova-compute[73029]:     </memballoon>
Aug 10 00:54:10 user nova-compute[73029]:   </devices>
Aug 10 00:54:10 user nova-compute[73029]: </domain>
Aug 10 00:54:10 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-831966501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-831966501',id=32,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-nr8n9cjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:53:55Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=3d6ce28c-39f0-432c-bfe3-a5891fb69021,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cb:18,bridge_name='br-int',has_traffic_filtering=True,id=858ac141-686d-4e33-9ee4-f90c5d43e834,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap858ac141-68') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG os_vif [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cb:18,bridge_name='br-int',has_traffic_filtering=True,id=858ac141-686d-4e33-9ee4-f90c5d43e834,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap858ac141-68') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap858ac141-68, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap858ac141-68, col_values=(('external_ids', {'iface-id': '858ac141-686d-4e33-9ee4-f90c5d43e834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:cb:18', 'vm-uuid': '3d6ce28c-39f0-432c-bfe3-a5891fb69021'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:10 user nova-compute[73029]: INFO os_vif [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cb:18,bridge_name='br-int',has_traffic_filtering=True,id=858ac141-686d-4e33-9ee4-f90c5d43e834,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap858ac141-68')
Aug 10 00:54:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:54:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No VIF found with MAC fa:16:3e:d8:cb:18, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-c29cbe40-cb66-4dbc-a90f-043539ed3ea4 req-be7cbc8f-247c-4c3d-8464-6636289fcbf2 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c29cbe40-cb66-4dbc-a90f-043539ed3ea4 req-be7cbc8f-247c-4c3d-8464-6636289fcbf2 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c29cbe40-cb66-4dbc-a90f-043539ed3ea4 req-be7cbc8f-247c-4c3d-8464-6636289fcbf2 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c29cbe40-cb66-4dbc-a90f-043539ed3ea4 req-be7cbc8f-247c-4c3d-8464-6636289fcbf2 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-c29cbe40-cb66-4dbc-a90f-043539ed3ea4 req-be7cbc8f-247c-4c3d-8464-6636289fcbf2 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:54:12 user nova-compute[73029]: WARNING nova.compute.manager [req-c29cbe40-cb66-4dbc-a90f-043539ed3ea4 req-be7cbc8f-247c-4c3d-8464-6636289fcbf2 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state building and task_state spawning.
Aug 10 00:54:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628854.2715583, 3d6ce28c-39f0-432c-bfe3-a5891fb69021 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:54:14 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] VM Resumed (Lifecycle Event)
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:54:14 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Instance spawned successfully.
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:14 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628854.2759085, 3d6ce28c-39f0-432c-bfe3-a5891fb69021 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:54:14 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] VM Started (Lifecycle Event)
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:54:14 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:54:14 user nova-compute[73029]: INFO nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Took 4.86 seconds to spawn the instance on the hypervisor.
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:54:14 user nova-compute[73029]: INFO nova.compute.manager [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Took 19.51 seconds to build instance.
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-d2bf2f80-71d0-4778-94d7-828938805f4a req-42edea86-562d-4e6f-9afc-454043be0648 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d2bf2f80-71d0-4778-94d7-828938805f4a req-42edea86-562d-4e6f-9afc-454043be0648 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d2bf2f80-71d0-4778-94d7-828938805f4a req-42edea86-562d-4e6f-9afc-454043be0648 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d2bf2f80-71d0-4778-94d7-828938805f4a req-42edea86-562d-4e6f-9afc-454043be0648 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-d2bf2f80-71d0-4778-94d7-828938805f4a req-42edea86-562d-4e6f-9afc-454043be0648 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:54:14 user nova-compute[73029]: WARNING nova.compute.manager [req-d2bf2f80-71d0-4778-94d7-828938805f4a req-42edea86-562d-4e6f-9afc-454043be0648 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state active and task_state None.
Aug 10 00:54:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5afbab3d-18d7-4d60-837b-2ba6a72e5a1a tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.637s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:54:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:54:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:54:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:54:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:54:25 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:54:25 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating instance_info_cache with network_info: [{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:54:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:54:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:54:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:54:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-f4281343-ac20-4974-b893-31c470f98391 req-655e600b-063d-4827-9906-e2c891c06fa6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-changed-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:54:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-f4281343-ac20-4974-b893-31c470f98391 req-655e600b-063d-4827-9906-e2c891c06fa6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Refreshing instance network info cache due to event network-changed-5b34c38b-4298-4f65-807d-1ca3bc317978. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:54:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f4281343-ac20-4974-b893-31c470f98391 req-655e600b-063d-4827-9906-e2c891c06fa6 service nova] Acquiring lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:54:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f4281343-ac20-4974-b893-31c470f98391 req-655e600b-063d-4827-9906-e2c891c06fa6 service nova] Acquired lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:54:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-f4281343-ac20-4974-b893-31c470f98391 req-655e600b-063d-4827-9906-e2c891c06fa6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Refreshing network info cache for port 5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:27 user nova-compute[73029]: INFO nova.compute.manager [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Detaching volume d2cd3aa8-5735-4614-8a26-08ac3f7a1199
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.network.neutron [req-f4281343-ac20-4974-b893-31c470f98391 req-655e600b-063d-4827-9906-e2c891c06fa6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updated VIF entry in instance network info cache for port 5b34c38b-4298-4f65-807d-1ca3bc317978. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.network.neutron [req-f4281343-ac20-4974-b893-31c470f98391 req-655e600b-063d-4827-9906-e2c891c06fa6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating instance_info_cache with network_info: [{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f4281343-ac20-4974-b893-31c470f98391 req-655e600b-063d-4827-9906-e2c891c06fa6 service nova] Releasing lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:54:27 user nova-compute[73029]: INFO nova.virt.block_device [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Attempting to driver detach volume d2cd3aa8-5735-4614-8a26-08ac3f7a1199 from mountpoint /dev/vdb
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Attempting to detach device vdb from instance 03d2b73d-de9a-4669-8d31-f3d38063faac from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:54:27 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:54:27 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:54:27 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:54:27 user nova-compute[73029]:   <serial>d2cd3aa8-5735-4614-8a26-08ac3f7a1199</serial>
Aug 10 00:54:27 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:54:27 user nova-compute[73029]: </disk>
Aug 10 00:54:27 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:54:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Successfully detached device vdb from instance 03d2b73d-de9a-4669-8d31-f3d38063faac from the persistent domain config.
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03d2b73d-de9a-4669-8d31-f3d38063faac from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:54:27 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:54:27 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:54:27 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:54:27 user nova-compute[73029]:   <serial>d2cd3aa8-5735-4614-8a26-08ac3f7a1199</serial>
Aug 10 00:54:27 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:54:27 user nova-compute[73029]: </disk>
Aug 10 00:54:27 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628867.6772056, 03d2b73d-de9a-4669-8d31-f3d38063faac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:54:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Successfully detached device vdb from instance 03d2b73d-de9a-4669-8d31-f3d38063faac from the live domain config.
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQmCqGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:54:27 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7d8f9e-6c53-4161-afc9-74b81151b44f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddc3d71-8ada-4500-ba92-f6c2efe01509]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:54:27 user nova-compute[73029]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:54:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 (non-flash)
Aug 10 00:54:27 user nova-compute[73029]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:54:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751c1903a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdb1f88-4731-4fb3-9d78-8f28feb07603]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad52ecb-003e-4f3b-80d1-f2e2e06a3bc6]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[62597f83-c1f2-4a8b-bed9-ca528c76d351]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[636b411a-845d-4431-a4c6-c02ad3223ab6]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e84e64-7000-46b2-bcd5-9194b1fcd32f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b87ac6-50a2-463e-9447-b2d2fb9576ce]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199, portal: 172.16.0.220,3260]
Aug 10 00:54:27 user nova-compute[73029]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199, portal: 172.16.0.220,3260] successful.
Aug 10 00:54:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2cd3aa8-5735-4614-8a26-08ac3f7a1199 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7174a7b-e280-455a-8c2a-d94ad8c21cd0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] <== disconnect_volume: return (281ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:54:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:54:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:54:28 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'flavor' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:54:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-178f132b-5fc1-4fbc-82e1-dfc4656591fe req-542062f9-fafc-4ce6-9d28-2d5c38fb9bb6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-changed-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:54:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-178f132b-5fc1-4fbc-82e1-dfc4656591fe req-542062f9-fafc-4ce6-9d28-2d5c38fb9bb6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Refreshing instance network info cache due to event network-changed-5b34c38b-4298-4f65-807d-1ca3bc317978. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:54:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-178f132b-5fc1-4fbc-82e1-dfc4656591fe req-542062f9-fafc-4ce6-9d28-2d5c38fb9bb6 service nova] Acquiring lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:54:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-178f132b-5fc1-4fbc-82e1-dfc4656591fe req-542062f9-fafc-4ce6-9d28-2d5c38fb9bb6 service nova] Acquired lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:54:28 user nova-compute[73029]: DEBUG nova.network.neutron [req-178f132b-5fc1-4fbc-82e1-dfc4656591fe req-542062f9-fafc-4ce6-9d28-2d5c38fb9bb6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Refreshing network info cache for port 5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:54:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b0962af8-115f-4da5-8ad1-2ea6a9a2fbb4 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:54:29 user nova-compute[73029]: DEBUG nova.network.neutron [req-178f132b-5fc1-4fbc-82e1-dfc4656591fe req-542062f9-fafc-4ce6-9d28-2d5c38fb9bb6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updated VIF entry in instance network info cache for port 5b34c38b-4298-4f65-807d-1ca3bc317978. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:54:29 user nova-compute[73029]: DEBUG nova.network.neutron [req-178f132b-5fc1-4fbc-82e1-dfc4656591fe req-542062f9-fafc-4ce6-9d28-2d5c38fb9bb6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating instance_info_cache with network_info: [{"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:54:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-178f132b-5fc1-4fbc-82e1-dfc4656591fe req-542062f9-fafc-4ce6-9d28-2d5c38fb9bb6 service nova] Releasing lock "refresh_cache-03d2b73d-de9a-4669-8d31-f3d38063faac" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:54:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:54:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:54:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:54:33 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:54:33 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8095MB free_disk=25.17947769165039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 03d2b73d-de9a-4669-8d31-f3d38063faac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:54:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:54:34 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:54:34 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:54:34 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:54:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:54:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:54:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:54:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:54:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:54:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:54:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:54:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "a5068df0-a174-41d9-b6db-e992bc1fba19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:54:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:54:49 user nova-compute[73029]: INFO nova.compute.claims [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Claim successful on node user
Aug 10 00:54:50 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:54:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:54:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG nova.policy [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4e4682fd39448e5b08386bec3de4b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0830285a49344db872f7606cc837795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:54:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Creating image(s)
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "/opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "/opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.128s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk 1073741824" returned: 0 in 0.051s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.127s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG nova.network.neutron [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Successfully created port: 328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Cannot resize image /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lazy-loading 'migration_context' on Instance uuid a5068df0-a174-41d9-b6db-e992bc1fba19 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Ensure instance console log exists: /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Successfully updated port: 328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "refresh_cache-a5068df0-a174-41d9-b6db-e992bc1fba19" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquired lock "refresh_cache-a5068df0-a174-41d9-b6db-e992bc1fba19" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-38b80187-c35a-40df-9ca2-944a38307547 req-45bf9523-2685-4a13-a91e-efd7585d406c service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received event network-changed-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-38b80187-c35a-40df-9ca2-944a38307547 req-45bf9523-2685-4a13-a91e-efd7585d406c service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Refreshing instance network info cache due to event network-changed-328cb765-618d-49bd-9254-9d57fb7a4010. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-38b80187-c35a-40df-9ca2-944a38307547 req-45bf9523-2685-4a13-a91e-efd7585d406c service nova] Acquiring lock "refresh_cache-a5068df0-a174-41d9-b6db-e992bc1fba19" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Updating instance_info_cache with network_info: [{"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Releasing lock "refresh_cache-a5068df0-a174-41d9-b6db-e992bc1fba19" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Instance network_info: |[{"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-38b80187-c35a-40df-9ca2-944a38307547 req-45bf9523-2685-4a13-a91e-efd7585d406c service nova] Acquired lock "refresh_cache-a5068df0-a174-41d9-b6db-e992bc1fba19" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-38b80187-c35a-40df-9ca2-944a38307547 req-45bf9523-2685-4a13-a91e-efd7585d406c service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Refreshing network info cache for port 328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Start _get_guest_xml network_info=[{"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:54:52 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:54:52 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1335689954',display_name='tempest-ServersNegativeTestJSON-server-1335689954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1335689954',id=33,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0830285a49344db872f7606cc837795',ramdisk_id='',reservation_id='r-2fk572d3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-533946204',owner_user_name='tempest-ServersNegativeTestJSON-533946204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:54:51Z,user_data=None,user_id='e4e4682fd39448e5b08386bec3de4b22',uuid=a5068df0-a174-41d9-b6db-e992bc1fba19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converting VIF {"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=328cb765-618d-49bd-9254-9d57fb7a4010,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328cb765-61') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lazy-loading 'pci_devices' on Instance uuid a5068df0-a174-41d9-b6db-e992bc1fba19 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:54:52 user nova-compute[73029]:   <uuid>a5068df0-a174-41d9-b6db-e992bc1fba19</uuid>
Aug 10 00:54:52 user nova-compute[73029]:   <name>instance-00000021</name>
Aug 10 00:54:52 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:54:52 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:54:52 user nova-compute[73029]:   <metadata>
Aug 10 00:54:52 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:54:52 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:54:52 user nova-compute[73029]:       <nova:name>tempest-ServersNegativeTestJSON-server-1335689954</nova:name>
Aug 10 00:54:52 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:54:52</nova:creationTime>
Aug 10 00:54:52 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:54:52 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:54:52 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:54:52 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:54:52 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:54:52 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:54:52 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:54:52 user nova-compute[73029]:       <nova:owner>
Aug 10 00:54:52 user nova-compute[73029]:         <nova:user uuid="e4e4682fd39448e5b08386bec3de4b22">tempest-ServersNegativeTestJSON-533946204-project-member</nova:user>
Aug 10 00:54:52 user nova-compute[73029]:         <nova:project uuid="a0830285a49344db872f7606cc837795">tempest-ServersNegativeTestJSON-533946204</nova:project>
Aug 10 00:54:52 user nova-compute[73029]:       </nova:owner>
Aug 10 00:54:52 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:54:52 user nova-compute[73029]:       <nova:ports>
Aug 10 00:54:52 user nova-compute[73029]:         <nova:port uuid="328cb765-618d-49bd-9254-9d57fb7a4010">
Aug 10 00:54:52 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 00:54:52 user nova-compute[73029]:         </nova:port>
Aug 10 00:54:52 user nova-compute[73029]:       </nova:ports>
Aug 10 00:54:52 user nova-compute[73029]:     </nova:instance>
Aug 10 00:54:52 user nova-compute[73029]:   </metadata>
Aug 10 00:54:52 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:54:52 user nova-compute[73029]:     <system>
Aug 10 00:54:52 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:54:52 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:54:52 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:54:52 user nova-compute[73029]:       <entry name="serial">a5068df0-a174-41d9-b6db-e992bc1fba19</entry>
Aug 10 00:54:52 user nova-compute[73029]:       <entry name="uuid">a5068df0-a174-41d9-b6db-e992bc1fba19</entry>
Aug 10 00:54:52 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:54:52 user nova-compute[73029]:     </system>
Aug 10 00:54:52 user nova-compute[73029]:   </sysinfo>
Aug 10 00:54:52 user nova-compute[73029]:   <os>
Aug 10 00:54:52 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:54:52 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:54:52 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:54:52 user nova-compute[73029]:   </os>
Aug 10 00:54:52 user nova-compute[73029]:   <features>
Aug 10 00:54:52 user nova-compute[73029]:     <acpi/>
Aug 10 00:54:52 user nova-compute[73029]:     <apic/>
Aug 10 00:54:52 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:54:52 user nova-compute[73029]:   </features>
Aug 10 00:54:52 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:54:52 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:54:52 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:54:52 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:54:52 user nova-compute[73029]:   </clock>
Aug 10 00:54:52 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:54:52 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:54:52 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:54:52 user nova-compute[73029]:   </cpu>
Aug 10 00:54:52 user nova-compute[73029]:   <devices>
Aug 10 00:54:52 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:54:52 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:54:52 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk"/>
Aug 10 00:54:52 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:54:52 user nova-compute[73029]:     </disk>
Aug 10 00:54:52 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:54:52 user nova-compute[73029]:       <mac address="fa:16:3e:96:3e:28"/>
Aug 10 00:54:52 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:54:52 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:54:52 user nova-compute[73029]:       <target dev="tap328cb765-61"/>
Aug 10 00:54:52 user nova-compute[73029]:     </interface>
Aug 10 00:54:52 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:54:52 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/console.log" append="off"/>
Aug 10 00:54:52 user nova-compute[73029]:     </serial>
Aug 10 00:54:52 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:54:52 user nova-compute[73029]:     <video>
Aug 10 00:54:52 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:54:52 user nova-compute[73029]:     </video>
Aug 10 00:54:52 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:54:52 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:54:52 user nova-compute[73029]:     </rng>
Aug 10 00:54:52 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:54:52 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:54:52 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:54:52 user nova-compute[73029]:     </memballoon>
Aug 10 00:54:52 user nova-compute[73029]:   </devices>
Aug 10 00:54:52 user nova-compute[73029]: </domain>
Aug 10 00:54:52 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1335689954',display_name='tempest-ServersNegativeTestJSON-server-1335689954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1335689954',id=33,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0830285a49344db872f7606cc837795',ramdisk_id='',reservation_id='r-2fk572d3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-533946204',owner_user_name='tempest-ServersNegativeTestJSON-533946204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:54:51Z,user_data=None,user_id='e4e4682fd39448e5b08386bec3de4b22',uuid=a5068df0-a174-41d9-b6db-e992bc1fba19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converting VIF {"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=328cb765-618d-49bd-9254-9d57fb7a4010,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328cb765-61') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG os_vif [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=328cb765-618d-49bd-9254-9d57fb7a4010,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328cb765-61') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap328cb765-61, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap328cb765-61, col_values=(('external_ids', {'iface-id': '328cb765-618d-49bd-9254-9d57fb7a4010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:3e:28', 'vm-uuid': 'a5068df0-a174-41d9-b6db-e992bc1fba19'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:52 user nova-compute[73029]: INFO os_vif [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=328cb765-618d-49bd-9254-9d57fb7a4010,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328cb765-61')
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] No VIF found with MAC fa:16:3e:96:3e:28, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-38b80187-c35a-40df-9ca2-944a38307547 req-45bf9523-2685-4a13-a91e-efd7585d406c service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Updated VIF entry in instance network info cache for port 328cb765-618d-49bd-9254-9d57fb7a4010. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-38b80187-c35a-40df-9ca2-944a38307547 req-45bf9523-2685-4a13-a91e-efd7585d406c service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Updating instance_info_cache with network_info: [{"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:54:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-38b80187-c35a-40df-9ca2-944a38307547 req-45bf9523-2685-4a13-a91e-efd7585d406c service nova] Releasing lock "refresh_cache-a5068df0-a174-41d9-b6db-e992bc1fba19" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:54:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-ab0b41f4-adda-4bcd-9160-163e76945961 req-20e77645-5240-4cae-b784-22bf678f501d service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received event network-vif-plugged-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:54:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ab0b41f4-adda-4bcd-9160-163e76945961 req-20e77645-5240-4cae-b784-22bf678f501d service nova] Acquiring lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ab0b41f4-adda-4bcd-9160-163e76945961 req-20e77645-5240-4cae-b784-22bf678f501d service nova] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ab0b41f4-adda-4bcd-9160-163e76945961 req-20e77645-5240-4cae-b784-22bf678f501d service nova] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-ab0b41f4-adda-4bcd-9160-163e76945961 req-20e77645-5240-4cae-b784-22bf678f501d service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] No waiting events found dispatching network-vif-plugged-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:54:54 user nova-compute[73029]: WARNING nova.compute.manager [req-ab0b41f4-adda-4bcd-9160-163e76945961 req-20e77645-5240-4cae-b784-22bf678f501d service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received unexpected event network-vif-plugged-328cb765-618d-49bd-9254-9d57fb7a4010 for instance with vm_state building and task_state spawning.
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628895.9627678, a5068df0-a174-41d9-b6db-e992bc1fba19 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:54:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] VM Resumed (Lifecycle Event)
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:54:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Instance spawned successfully.
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:54:56 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:54:56 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628895.964067, a5068df0-a174-41d9-b6db-e992bc1fba19 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:54:56 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] VM Started (Lifecycle Event)
Aug 10 00:54:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:54:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:54:56 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:54:56 user nova-compute[73029]: INFO nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Took 5.52 seconds to spawn the instance on the hypervisor.
Aug 10 00:54:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:54:56 user nova-compute[73029]: INFO nova.compute.manager [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Took 6.25 seconds to build instance.
Aug 10 00:54:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b1e77a0c-caa7-4246-a348-1ae25c324492 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.334s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-6d001c56-7c2b-4a53-96e6-df4e2acab9f8 req-71c2a6f7-c2f2-4bf4-bae0-ac174711f4c1 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received event network-vif-plugged-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:54:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6d001c56-7c2b-4a53-96e6-df4e2acab9f8 req-71c2a6f7-c2f2-4bf4-bae0-ac174711f4c1 service nova] Acquiring lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:54:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6d001c56-7c2b-4a53-96e6-df4e2acab9f8 req-71c2a6f7-c2f2-4bf4-bae0-ac174711f4c1 service nova] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:54:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6d001c56-7c2b-4a53-96e6-df4e2acab9f8 req-71c2a6f7-c2f2-4bf4-bae0-ac174711f4c1 service nova] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:54:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-6d001c56-7c2b-4a53-96e6-df4e2acab9f8 req-71c2a6f7-c2f2-4bf4-bae0-ac174711f4c1 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] No waiting events found dispatching network-vif-plugged-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:54:56 user nova-compute[73029]: WARNING nova.compute.manager [req-6d001c56-7c2b-4a53-96e6-df4e2acab9f8 req-71c2a6f7-c2f2-4bf4-bae0-ac174711f4c1 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received unexpected event network-vif-plugged-328cb765-618d-49bd-9254-9d57fb7a4010 for instance with vm_state active and task_state None.
Aug 10 00:54:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:54:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:55:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:55:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:55:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:55:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:55:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:55:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:17 user nova-compute[73029]: INFO nova.compute.manager [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Terminating instance
Aug 10 00:55:17 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG nova.compute.manager [req-a14a410a-f86f-426b-b110-58738f3cab26 req-3108846c-63d2-4aa4-ad87-94d85bae81c6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-unplugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a14a410a-f86f-426b-b110-58738f3cab26 req-3108846c-63d2-4aa4-ad87-94d85bae81c6 service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a14a410a-f86f-426b-b110-58738f3cab26 req-3108846c-63d2-4aa4-ad87-94d85bae81c6 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a14a410a-f86f-426b-b110-58738f3cab26 req-3108846c-63d2-4aa4-ad87-94d85bae81c6 service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG nova.compute.manager [req-a14a410a-f86f-426b-b110-58738f3cab26 req-3108846c-63d2-4aa4-ad87-94d85bae81c6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-unplugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG nova.compute.manager [req-a14a410a-f86f-426b-b110-58738f3cab26 req-3108846c-63d2-4aa4-ad87-94d85bae81c6 service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-unplugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Instance destroyed successfully.
Aug 10 00:55:18 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'resources' on Instance uuid 03d2b73d-de9a-4669-8d31-f3d38063faac {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-398395019',display_name='tempest-ServerRescueNegativeTestJSON-server-398395019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-398395019',id=28,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7gu9lAx8RZscHpV51sLlq+jmbUmX3cj6dU9fSYJOfds8jWOFd+VGlw8A3s5DhjojkrDtcsYc3LmedBHmlwJ8c4jMklrj3BDyOgOoPfuiptIqbnAnTxkAkejQV+KuITlg==',key_name='tempest-keypair-2057180871',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-m8028215',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a4fb6b058c64442b1688a3962849322',uuid=03d2b73d-de9a-4669-8d31-f3d38063faac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "5b34c38b-4298-4f65-807d-1ca3bc317978", "address": "fa:16:3e:e9:ee:58", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b34c38b-42", "ovs_interfaceid": "5b34c38b-4298-4f65-807d-1ca3bc317978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ee:58,bridge_name='br-int',has_traffic_filtering=True,id=5b34c38b-4298-4f65-807d-1ca3bc317978,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b34c38b-42') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG os_vif [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ee:58,bridge_name='br-int',has_traffic_filtering=True,id=5b34c38b-4298-4f65-807d-1ca3bc317978,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b34c38b-42') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b34c38b-42, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:18 user nova-compute[73029]: INFO os_vif [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ee:58,bridge_name='br-int',has_traffic_filtering=True,id=5b34c38b-4298-4f65-807d-1ca3bc317978,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b34c38b-42')
Aug 10 00:55:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Deleting instance files /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac_del
Aug 10 00:55:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Deletion of /opt/stack/data/nova/instances/03d2b73d-de9a-4669-8d31-f3d38063faac_del complete
Aug 10 00:55:18 user nova-compute[73029]: INFO nova.compute.manager [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 10 00:55:18 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:55:18 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:55:19 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Took 0.72 seconds to deallocate network for instance.
Aug 10 00:55:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:19 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Deleted allocations for instance 03d2b73d-de9a-4669-8d31-f3d38063faac
Aug 10 00:55:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9df1f7b5-7326-4e0f-8663-d0ec6d7972da tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.984s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-a0a713eb-2cf5-4ead-8984-31f99e8177e3 req-aa699919-48ac-4033-b1a2-f5a033a89c2a service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a0a713eb-2cf5-4ead-8984-31f99e8177e3 req-aa699919-48ac-4033-b1a2-f5a033a89c2a service nova] Acquiring lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a0a713eb-2cf5-4ead-8984-31f99e8177e3 req-aa699919-48ac-4033-b1a2-f5a033a89c2a service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a0a713eb-2cf5-4ead-8984-31f99e8177e3 req-aa699919-48ac-4033-b1a2-f5a033a89c2a service nova] Lock "03d2b73d-de9a-4669-8d31-f3d38063faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-a0a713eb-2cf5-4ead-8984-31f99e8177e3 req-aa699919-48ac-4033-b1a2-f5a033a89c2a service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] No waiting events found dispatching network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:55:19 user nova-compute[73029]: WARNING nova.compute.manager [req-a0a713eb-2cf5-4ead-8984-31f99e8177e3 req-aa699919-48ac-4033-b1a2-f5a033a89c2a service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received unexpected event network-vif-plugged-5b34c38b-4298-4f65-807d-1ca3bc317978 for instance with vm_state deleted and task_state None.
Aug 10 00:55:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-a0a713eb-2cf5-4ead-8984-31f99e8177e3 req-aa699919-48ac-4033-b1a2-f5a033a89c2a service nova] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Received event network-vif-deleted-5b34c38b-4298-4f65-807d-1ca3bc317978 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:55:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updating instance_info_cache with network_info: [{"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-7f939eda-5083-4db3-9538-d2cdb583357d req-993e3bc2-fb16-4040-8bea-9b5f3665b975 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received event network-changed-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:55:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-7f939eda-5083-4db3-9538-d2cdb583357d req-993e3bc2-fb16-4040-8bea-9b5f3665b975 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Refreshing instance network info cache due to event network-changed-4ee4e715-c241-40fe-80d4-f848e01a8693. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:55:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7f939eda-5083-4db3-9538-d2cdb583357d req-993e3bc2-fb16-4040-8bea-9b5f3665b975 service nova] Acquiring lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:55:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7f939eda-5083-4db3-9538-d2cdb583357d req-993e3bc2-fb16-4040-8bea-9b5f3665b975 service nova] Acquired lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:55:29 user nova-compute[73029]: DEBUG nova.network.neutron [req-7f939eda-5083-4db3-9538-d2cdb583357d req-993e3bc2-fb16-4040-8bea-9b5f3665b975 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Refreshing network info cache for port 4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:55:30 user nova-compute[73029]: DEBUG nova.network.neutron [req-7f939eda-5083-4db3-9538-d2cdb583357d req-993e3bc2-fb16-4040-8bea-9b5f3665b975 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updated VIF entry in instance network info cache for port 4ee4e715-c241-40fe-80d4-f848e01a8693. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:55:30 user nova-compute[73029]: DEBUG nova.network.neutron [req-7f939eda-5083-4db3-9538-d2cdb583357d req-993e3bc2-fb16-4040-8bea-9b5f3665b975 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updating instance_info_cache with network_info: [{"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:55:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:55:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7f939eda-5083-4db3-9538-d2cdb583357d req-993e3bc2-fb16-4040-8bea-9b5f3665b975 service nova] Releasing lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:55:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628918.2533185, 03d2b73d-de9a-4669-8d31-f3d38063faac => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:55:33 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] VM Stopped (Lifecycle Event)
Aug 10 00:55:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4781d984-2843-4f5c-93c9-950964d0e9f2 None None] [instance: 03d2b73d-de9a-4669-8d31-f3d38063faac] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:34 user nova-compute[73029]: INFO nova.compute.manager [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attaching volume 3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 to /dev/vdb
Aug 10 00:55:34 user nova-compute[73029]: DEBUG os_brick.utils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[659a59f8-f912-48d5-ab15-3de1ca05cc95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3cac77-8b2d-46e5-81fa-a6485bb22858]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[125a126a-2090-44b7-84a6-ff1b43c2b9ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[399165c1-9347-4778-bbf8-07a8379eb3ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:55:34 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64556d1-64a5-4c0c-bb8d-bb47ff400557]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG os_brick.utils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updating existing volume attachment record: b5b9d669-08db-4bd2-8fcc-51931bd78032 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:55:35 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:55:35 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8095MB free_disk=25.177772521972656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 34141f58-5c62-4245-bd2a-06d4e4518529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a5068df0-a174-41d9-b6db-e992bc1fba19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:55:35 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:55:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:55:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:55:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfuZkQFq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:55:43 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:55:43 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:55:43 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bb3896-06ad-4fad-94b6-d9d7e5ee379b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:55:43 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4148be9f-5cdb-4416-b78f-d5838d2cacb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16] added
Aug 10 00:55:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcb0613-b984-42e7-b356-9c09f7812ac5]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeb8795-4c64-44f4-b6e1-b3daadbeb54f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vfuZkQFq {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vfuZkQFq" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[143a99b1-01f3-49dd-924d-420b7a5c4baa]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vfuZkQFq'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[520935a7-0ce0-4e90-b64f-e2be967ee334]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b1273f-de75-4e52-be86-b0608095301f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:55:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:55:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[20986961-efae-4975-af3a-143a50b7660b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16, portal: 172.16.0.220,3260]
Aug 10 00:55:43 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16, portal: 172.16.0.220,3260] successful.
Aug 10 00:55:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[935d1d84-89a8-46ea-8b58-7fecb6e6d729]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4089a453-5e78-4aec-9e61-cbe9c37cef35]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:55:43 user nova-compute[73029]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 (non-flash)
Aug 10 00:55:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:55:43 user nova-compute[73029]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 (non-flash)
Aug 10 00:55:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b4b1ab-9766-430d-a38b-14d4f73ea24b]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:43 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfuZkQFq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26266306164396564', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266306164396564', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG nova.objects.instance [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:55:44 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:55:44 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:55:44 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:55:44 user nova-compute[73029]:   <serial>3b3bca9e-bd42-4fd2-9db2-8be50fa19d16</serial>
Aug 10 00:55:44 user nova-compute[73029]: </disk>
Aug 10 00:55:44 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:55:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No VIF found with MAC fa:16:3e:fd:b9:fa, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:55:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3580e14c-8d63-4e2e-93ec-492808708993 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.719s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:45 user nova-compute[73029]: INFO nova.compute.manager [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Rescuing
Aug 10 00:55:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:55:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquired lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:55:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG nova.network.neutron [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updating instance_info_cache with network_info: [{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Releasing lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a0a8233-ae24-473a-83ee-d2e9bf04a747 req-466c191a-e1d8-4574-ae56-a9db4ac2fadb service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-unplugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a0a8233-ae24-473a-83ee-d2e9bf04a747 req-466c191a-e1d8-4574-ae56-a9db4ac2fadb service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a0a8233-ae24-473a-83ee-d2e9bf04a747 req-466c191a-e1d8-4574-ae56-a9db4ac2fadb service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a0a8233-ae24-473a-83ee-d2e9bf04a747 req-466c191a-e1d8-4574-ae56-a9db4ac2fadb service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a0a8233-ae24-473a-83ee-d2e9bf04a747 req-466c191a-e1d8-4574-ae56-a9db4ac2fadb service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-unplugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:55:46 user nova-compute[73029]: WARNING nova.compute.manager [req-6a0a8233-ae24-473a-83ee-d2e9bf04a747 req-466c191a-e1d8-4574-ae56-a9db4ac2fadb service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-unplugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state active and task_state rescuing.
Aug 10 00:55:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:47 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Instance destroyed successfully.
Aug 10 00:55:47 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Attempting a stable device rescue
Aug 10 00:55:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73029) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 10 00:55:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Instance directory exists: not creating {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 10 00:55:47 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Creating image(s)
Aug 10 00:55:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "/opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "/opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.061s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:47 user nova-compute[73029]: DEBUG nova.objects.instance [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:55:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "579b586d048d945736fadf52b73cc94d18b2f7a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "579b586d048d945736fadf52b73cc94d18b2f7a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2.part --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG nova.virt.images [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] d971ccd0-e137-4aa2-89bd-d59901e3d237 was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2.part /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-60196d90-7fab-47c1-9d45-116a534c5197 req-f4173e06-fb30-4c5b-9936-885eb3331735 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-60196d90-7fab-47c1-9d45-116a534c5197 req-f4173e06-fb30-4c5b-9936-885eb3331735 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-60196d90-7fab-47c1-9d45-116a534c5197 req-f4173e06-fb30-4c5b-9936-885eb3331735 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-60196d90-7fab-47c1-9d45-116a534c5197 req-f4173e06-fb30-4c5b-9936-885eb3331735 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-60196d90-7fab-47c1-9d45-116a534c5197 req-f4173e06-fb30-4c5b-9936-885eb3331735 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:55:48 user nova-compute[73029]: WARNING nova.compute.manager [req-60196d90-7fab-47c1-9d45-116a534c5197 req-f4173e06-fb30-4c5b-9936-885eb3331735 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state active and task_state rescuing.
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2.part /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2.converted" returned: 0 in 0.561s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "579b586d048d945736fadf52b73cc94d18b2f7a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.116s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "579b586d048d945736fadf52b73cc94d18b2f7a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "579b586d048d945736fadf52b73cc94d18b2f7a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2 --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2,backing_fmt=raw /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2,backing_fmt=raw /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue" returned: 0 in 0.054s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "579b586d048d945736fadf52b73cc94d18b2f7a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.objects.instance [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'migration_context' on Instance uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Start _get_guest_xml network_info=[{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "vif_mac": "fa:16:3e:d8:cb:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd971ccd0-e137-4aa2-89bd-d59901e3d237', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '64cc763f-47b6-4d18-9776-a5e089a63ce1', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupvtCwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3d6ce28c-39f0-432c-bfe3-a5891fb69021', 'attached_at': '', 'detached_at': '', 'volume_id': 'b657d186-0636-4d90-a0f4-a03cc37eb04e', 'serial': 'b657d186-0636-4d90-a0f4-a03cc37eb04e'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.objects.instance [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'resources' on Instance uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.objects.instance [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'numa_topology' on Instance uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:55:49 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:55:49 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.objects.instance [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupvtCwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:55:49 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:55:49 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:55:49 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d966f9-d2fa-4c5a-819f-29fc6bcb3404]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DupvtCwZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 10 00:55:49 user nova-compute[73029]: node.name = iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e
Aug 10 00:55:49 user nova-compute[73029]: node.tpgt = -1
Aug 10 00:55:49 user nova-compute[73029]: node.startup = automatic
Aug 10 00:55:49 user nova-compute[73029]: node.leading_login = No
Aug 10 00:55:49 user nova-compute[73029]: iface.iscsi_ifacename = default
Aug 10 00:55:49 user nova-compute[73029]: iface.net_ifacename = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.ipaddress = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.prefix_len = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.hwaddress = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.transport_name = tcp
Aug 10 00:55:49 user nova-compute[73029]: iface.initiatorname = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.state = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.vlan_id = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.vlan_priority = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.vlan_state = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.iface_num = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.mtu = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.port = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.bootproto = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.subnet_mask = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.gateway = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.dhcp_alt_client_id_state = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.dhcp_alt_client_id = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.dhcp_dns = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.dhcp_learn_iqn = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.dhcp_req_vendor_id_state = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.dhcp_vendor_id_state = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.dhcp_vendor_id = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.dhcp_slp_da = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.fragmentation = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.gratuitous_arp = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.incoming_forwarding = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.tos_state = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.tos = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.ttl = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.delayed_ack = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.tcp_nagle = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.tcp_wsf_state = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.tcp_wsf = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.tcp_timer_scale = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.tcp_timestamp = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.redirect = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.def_task_mgmt_timeout = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.header_digest = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.data_digest = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.immediate_data = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.initial_r2t = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.data_seq_inorder = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.data_pdu_inorder = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.erl = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.max_receive_data_len = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.first_burst_len = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.max_outstanding_r2t = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.max_burst_len = 0
Aug 10 00:55:49 user nova-compute[73029]: iface.chap_auth = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.bidi_chap = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.strict_login_compliance = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.discovery_auth = <empty>
Aug 10 00:55:49 user nova-compute[73029]: iface.discovery_logout = <empty>
Aug 10 00:55:49 user nova-compute[73029]: node.discovery_address = <empty>
Aug 10 00:55:49 user nova-compute[73029]: node.discovery_port = 0
Aug 10 00:55:49 user nova-compute[73029]: node.discovery_type = static
Aug 10 00:55:49 user nova-compute[73029]: node.session.initial_cmdsn = 0
Aug 10 00:55:49 user nova-compute[73029]: node.session.initial_login_retry_max = 8
Aug 10 00:55:49 user nova-compute[73029]: node.session.xmit_thread_priority = -20
Aug 10 00:55:49 user nova-compute[73029]: node.session.cmds_max = 128
Aug 10 00:55:49 user nova-compute[73029]: node.session.queue_depth = 32
Aug 10 00:55:49 user nova-compute[73029]: node.session.nr_sessions = 1
Aug 10 00:55:49 user nova-compute[73029]: node.session.auth.authmethod = CHAP
Aug 10 00:55:49 user nova-compute[73029]: node.session.auth.username = DupvtCwZ
Aug 10 00:55:49 user nova-compute[73029]: node.session.auth.password = ***
Aug 10 00:55:49 user nova-compute[73029]: node.session.auth.username_in = <empty>
Aug 10 00:55:49 user nova-compute[73029]: node.session.auth.password_in = <empty>
Aug 10 00:55:49 user nova-compute[73029]: node.session.auth.chap_algs = MD5
Aug 10 00:55:49 user nova-compute[73029]: node.session.timeo.replacement_timeout = 120
Aug 10 00:55:49 user nova-compute[73029]: node.session.err_timeo.abort_timeout = 15
Aug 10 00:55:49 user nova-compute[73029]: node.session.err_timeo.lu_reset_timeout = 30
Aug 10 00:55:49 user nova-compute[73029]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 10 00:55:49 user nova-compute[73029]: node.session.err_timeo.host_reset_timeout = 60
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.FastAbort = Yes
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.InitialR2T = No
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.ImmediateData = Yes
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.FirstBurstLength = 262144
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.MaxBurstLength = 16776192
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.DefaultTime2Retain = 0
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.DefaultTime2Wait = 2
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.MaxConnections = 1
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 10 00:55:49 user nova-compute[73029]: node.session.iscsi.ERL = 0
Aug 10 00:55:49 user nova-compute[73029]: node.session.scan = manual
Aug 10 00:55:49 user nova-compute[73029]: node.session.reopen_max = 0
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].address = 172.16.0.220
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].port = 3260
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].startup = manual
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].tcp.window_size = 524288
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].tcp.type_of_service = 0
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].timeo.logout_timeout = 15
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].timeo.login_timeout = 15
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].timeo.auth_timeout = 45
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].timeo.noop_out_interval = 5
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].timeo.noop_out_timeout = 5
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].iscsi.HeaderDigest = None
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].iscsi.DataDigest = None
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].iscsi.IFMarker = No
Aug 10 00:55:49 user nova-compute[73029]: node.conn[0].iscsi.OFMarker = No
Aug 10 00:55:49 user nova-compute[73029]: # END RECORD
Aug 10 00:55:49 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb0793a-adc9-4ce9-a331-1c5ebedfa741]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb8c5b9-4784-4886-8398-ec5551bc0fff]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DupvtCwZ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DupvtCwZ" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[383cf157-92c1-47b6-a279-e8a7c0cc4031]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DupvtCwZ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdd4f0d-0f46-47cb-9d0e-d461ef211d81]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8077088-2b2c-4de1-8b4b-ca229666a896]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:55:49 user nova-compute[73029]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 (non-flash)
Aug 10 00:55:49 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:55:49 user nova-compute[73029]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 (non-flash)
Aug 10 00:55:49 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.138s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] HCTL ('34', '0', '0', 0) found on session 38 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2980787-b6a9-4d1c-b7e9-88c3251b70a3]: (4, ('0 0 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching for a device in session 38 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupvtCwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.161s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] <== connect_volume: return (162ms) {'type': 'block', 'scsi_wwn': '26638643139363365', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638643139363365', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-831966501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-831966501',id=32,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-nr8n9cjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:54:14Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=3d6ce28c-39f0-432c-bfe3-a5891fb69021,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "vif_mac": "fa:16:3e:d8:cb:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "vif_mac": "fa:16:3e:d8:cb:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:cb:18,bridge_name='br-int',has_traffic_filtering=True,id=858ac141-686d-4e33-9ee4-f90c5d43e834,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap858ac141-68') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.objects.instance [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:55:49 user nova-compute[73029]:   <uuid>3d6ce28c-39f0-432c-bfe3-a5891fb69021</uuid>
Aug 10 00:55:49 user nova-compute[73029]:   <name>instance-00000020</name>
Aug 10 00:55:49 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:55:49 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:55:49 user nova-compute[73029]:   <metadata>
Aug 10 00:55:49 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:55:49 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:55:49 user nova-compute[73029]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-831966501</nova:name>
Aug 10 00:55:49 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:55:49</nova:creationTime>
Aug 10 00:55:49 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:55:49 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:55:49 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:55:49 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:55:49 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:55:49 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:55:49 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:55:49 user nova-compute[73029]:       <nova:owner>
Aug 10 00:55:49 user nova-compute[73029]:         <nova:user uuid="6d34a91746034f349b7eeccfd372f21a">tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member</nova:user>
Aug 10 00:55:49 user nova-compute[73029]:         <nova:project uuid="39027fdade2f41048db7d3855f3197cc">tempest-ServerBootFromVolumeStableRescueTest-1463443327</nova:project>
Aug 10 00:55:49 user nova-compute[73029]:       </nova:owner>
Aug 10 00:55:49 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:55:49 user nova-compute[73029]:       <nova:ports>
Aug 10 00:55:49 user nova-compute[73029]:         <nova:port uuid="858ac141-686d-4e33-9ee4-f90c5d43e834">
Aug 10 00:55:49 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 10 00:55:49 user nova-compute[73029]:         </nova:port>
Aug 10 00:55:49 user nova-compute[73029]:       </nova:ports>
Aug 10 00:55:49 user nova-compute[73029]:     </nova:instance>
Aug 10 00:55:49 user nova-compute[73029]:   </metadata>
Aug 10 00:55:49 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:55:49 user nova-compute[73029]:     <system>
Aug 10 00:55:49 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:55:49 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:55:49 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:55:49 user nova-compute[73029]:       <entry name="serial">3d6ce28c-39f0-432c-bfe3-a5891fb69021</entry>
Aug 10 00:55:49 user nova-compute[73029]:       <entry name="uuid">3d6ce28c-39f0-432c-bfe3-a5891fb69021</entry>
Aug 10 00:55:49 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:55:49 user nova-compute[73029]:     </system>
Aug 10 00:55:49 user nova-compute[73029]:   </sysinfo>
Aug 10 00:55:49 user nova-compute[73029]:   <os>
Aug 10 00:55:49 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:55:49 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:55:49 user nova-compute[73029]:   </os>
Aug 10 00:55:49 user nova-compute[73029]:   <features>
Aug 10 00:55:49 user nova-compute[73029]:     <acpi/>
Aug 10 00:55:49 user nova-compute[73029]:     <apic/>
Aug 10 00:55:49 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:55:49 user nova-compute[73029]:   </features>
Aug 10 00:55:49 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:55:49 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:55:49 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:55:49 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:55:49 user nova-compute[73029]:   </clock>
Aug 10 00:55:49 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:55:49 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:55:49 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:55:49 user nova-compute[73029]:   </cpu>
Aug 10 00:55:49 user nova-compute[73029]:   <devices>
Aug 10 00:55:49 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 00:55:49 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:55:49 user nova-compute[73029]:       <source dev="/dev/sdc"/>
Aug 10 00:55:49 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:55:49 user nova-compute[73029]:       <serial>b657d186-0636-4d90-a0f4-a03cc37eb04e</serial>
Aug 10 00:55:49 user nova-compute[73029]:     </disk>
Aug 10 00:55:49 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:55:49 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:55:49 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue"/>
Aug 10 00:55:49 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 00:55:49 user nova-compute[73029]:       <boot order="1"/>
Aug 10 00:55:49 user nova-compute[73029]:     </disk>
Aug 10 00:55:49 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:55:49 user nova-compute[73029]:       <mac address="fa:16:3e:d8:cb:18"/>
Aug 10 00:55:49 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:55:49 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:55:49 user nova-compute[73029]:       <target dev="tap858ac141-68"/>
Aug 10 00:55:49 user nova-compute[73029]:     </interface>
Aug 10 00:55:49 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:55:49 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/console.log" append="off"/>
Aug 10 00:55:49 user nova-compute[73029]:     </serial>
Aug 10 00:55:49 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:55:49 user nova-compute[73029]:     <video>
Aug 10 00:55:49 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:55:49 user nova-compute[73029]:     </video>
Aug 10 00:55:49 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:55:49 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:55:49 user nova-compute[73029]:     </rng>
Aug 10 00:55:49 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:55:49 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:55:49 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:55:49 user nova-compute[73029]:     </memballoon>
Aug 10 00:55:49 user nova-compute[73029]:   </devices>
Aug 10 00:55:49 user nova-compute[73029]: </domain>
Aug 10 00:55:49 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:55:49 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Instance destroyed successfully.
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:55:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No VIF found with MAC fa:16:3e:d8:cb:18, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:55:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-5af2a1e6-f651-48e8-842e-76c5fff9fc22 req-bf68b190-92ce-4c65-a3b6-05e3ed2a3191 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:55:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5af2a1e6-f651-48e8-842e-76c5fff9fc22 req-bf68b190-92ce-4c65-a3b6-05e3ed2a3191 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5af2a1e6-f651-48e8-842e-76c5fff9fc22 req-bf68b190-92ce-4c65-a3b6-05e3ed2a3191 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5af2a1e6-f651-48e8-842e-76c5fff9fc22 req-bf68b190-92ce-4c65-a3b6-05e3ed2a3191 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-5af2a1e6-f651-48e8-842e-76c5fff9fc22 req-bf68b190-92ce-4c65-a3b6-05e3ed2a3191 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:55:51 user nova-compute[73029]: WARNING nova.compute.manager [req-5af2a1e6-f651-48e8-842e-76c5fff9fc22 req-bf68b190-92ce-4c65-a3b6-05e3ed2a3191 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state active and task_state rescuing.
Aug 10 00:55:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-fcb4b1e9-fbb4-4d9c-9b1a-b5f75fd177b4 req-3e18ffc9-e962-493b-a565-291007ea42b7 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fcb4b1e9-fbb4-4d9c-9b1a-b5f75fd177b4 req-3e18ffc9-e962-493b-a565-291007ea42b7 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fcb4b1e9-fbb4-4d9c-9b1a-b5f75fd177b4 req-3e18ffc9-e962-493b-a565-291007ea42b7 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fcb4b1e9-fbb4-4d9c-9b1a-b5f75fd177b4 req-3e18ffc9-e962-493b-a565-291007ea42b7 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-fcb4b1e9-fbb4-4d9c-9b1a-b5f75fd177b4 req-3e18ffc9-e962-493b-a565-291007ea42b7 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:55:53 user nova-compute[73029]: WARNING nova.compute.manager [req-fcb4b1e9-fbb4-4d9c-9b1a-b5f75fd177b4 req-3e18ffc9-e962-493b-a565-291007ea42b7 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state active and task_state rescuing.
Aug 10 00:55:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 3d6ce28c-39f0-432c-bfe3-a5891fb69021 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628953.584699, 3d6ce28c-39f0-432c-bfe3-a5891fb69021 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:55:53 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] VM Resumed (Lifecycle Event)
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-90eee5a3-8445-4cfc-a3ab-09e029ec6d18 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:55:53 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691628953.5866122, 3d6ce28c-39f0-432c-bfe3-a5891fb69021 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:55:53 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] VM Started (Lifecycle Event)
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:55:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:55:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:55:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:09 user nova-compute[73029]: INFO nova.compute.manager [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Detaching volume 3b3bca9e-bd42-4fd2-9db2-8be50fa19d16
Aug 10 00:56:09 user nova-compute[73029]: INFO nova.virt.block_device [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attempting to driver detach volume 3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 from mountpoint /dev/vdb
Aug 10 00:56:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Attempting to detach device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:56:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:56:09 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:56:09 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:56:09 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:56:09 user nova-compute[73029]:   <serial>3b3bca9e-bd42-4fd2-9db2-8be50fa19d16</serial>
Aug 10 00:56:09 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:56:09 user nova-compute[73029]: </disk>
Aug 10 00:56:09 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:56:09 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully detached device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the persistent domain config.
Aug 10 00:56:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:56:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:56:09 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:56:09 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:56:09 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:56:09 user nova-compute[73029]:   <serial>3b3bca9e-bd42-4fd2-9db2-8be50fa19d16</serial>
Aug 10 00:56:09 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:56:09 user nova-compute[73029]: </disk>
Aug 10 00:56:09 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691628970.1474726, cd1ef428-2411-4cb8-bccd-7741e05e1a50 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:56:10 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully detached device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the live domain config.
Aug 10 00:56:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfuZkQFq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:56:10 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba3ad32-9cab-4acc-ab92-8bd45064700e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0939217-e615-4219-b609-e8d43586bcc8]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:56:10 user nova-compute[73029]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 (non-flash)
Aug 10 00:56:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:56:10 user nova-compute[73029]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 (non-flash)
Aug 10 00:56:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75147684c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dd50af-52be-4d56-b4d3-0f314d7881e1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[757e826a-3176-4df6-8a1b-35227e955246]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6fc8c0-33f2-4fd3-a638-9711478c5155]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d5f843-21fe-4afd-a485-eb88204319ef]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f698868-c5f7-42fb-9d85-cac732c4025b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe862ee-f865-4df6-aa9e-8d401cb1313f]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16, portal: 172.16.0.220,3260]
Aug 10 00:56:10 user nova-compute[73029]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16, portal: 172.16.0.220,3260] successful.
Aug 10 00:56:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3bca9e-bd42-4fd2-9db2-8be50fa19d16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c7083c-d6e0-4fd5-82c1-b979b2c750ce]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== disconnect_volume: return (276ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:56:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:56:11 user nova-compute[73029]: DEBUG nova.objects.instance [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:56:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fb7aba35-f18e-4bd6-bae9-7f871190e3a4 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.599s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "34141f58-5c62-4245-bd2a-06d4e4518529" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:20 user nova-compute[73029]: INFO nova.compute.manager [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Terminating instance
Aug 10 00:56:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:56:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-cf73bd11-3134-41fe-b1da-1819dbb5e120 req-d662cfef-00bd-4519-a869-13a87a267e1b service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-unplugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cf73bd11-3134-41fe-b1da-1819dbb5e120 req-d662cfef-00bd-4519-a869-13a87a267e1b service nova] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cf73bd11-3134-41fe-b1da-1819dbb5e120 req-d662cfef-00bd-4519-a869-13a87a267e1b service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cf73bd11-3134-41fe-b1da-1819dbb5e120 req-d662cfef-00bd-4519-a869-13a87a267e1b service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-cf73bd11-3134-41fe-b1da-1819dbb5e120 req-d662cfef-00bd-4519-a869-13a87a267e1b service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] No waiting events found dispatching network-vif-unplugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-cf73bd11-3134-41fe-b1da-1819dbb5e120 req-d662cfef-00bd-4519-a869-13a87a267e1b service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-unplugged-e5a3d05c-7b55-4c15-9928-da308650b378 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Instance destroyed successfully.
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'resources' on Instance uuid 34141f58-5c62-4245-bd2a-06d4e4518529 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1615132056',display_name='tempest-ServerRescueNegativeTestJSON-server-1615132056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1615132056',id=17,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:41:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-tjlw8zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:42:00Z,user_data=None,user_id='4a4fb6b058c64442b1688a3962849322',uuid=34141f58-5c62-4245-bd2a-06d4e4518529,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "e5a3d05c-7b55-4c15-9928-da308650b378", "address": "fa:16:3e:ed:48:80", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a3d05c-7b", "ovs_interfaceid": "e5a3d05c-7b55-4c15-9928-da308650b378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e5a3d05c-7b55-4c15-9928-da308650b378,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a3d05c-7b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG os_vif [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e5a3d05c-7b55-4c15-9928-da308650b378,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a3d05c-7b') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5a3d05c-7b, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:56:21 user nova-compute[73029]: INFO os_vif [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e5a3d05c-7b55-4c15-9928-da308650b378,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a3d05c-7b')
Aug 10 00:56:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Deleting instance files /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529_del
Aug 10 00:56:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Deletion of /opt/stack/data/nova/instances/34141f58-5c62-4245-bd2a-06d4e4518529_del complete
Aug 10 00:56:21 user nova-compute[73029]: INFO nova.compute.manager [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 10 00:56:21 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:56:21 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:56:21 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Took 0.48 seconds to deallocate network for instance.
Aug 10 00:56:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-5d7d7521-e9ee-40ae-8802-a9272b26bdb8 req-8266f1bf-5b8f-4ecd-adfa-98bc9d744907 service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-deleted-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:56:22 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:56:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:56:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:22 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Deleted allocations for instance 34141f58-5c62-4245-bd2a-06d4e4518529
Aug 10 00:56:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04c0bbcf-9f41-4e9b-ab71-472767b57b4c tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "34141f58-5c62-4245-bd2a-06d4e4518529" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.606s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-abc26266-8b5f-4132-bb1a-93a34915f4b4 req-ecd22154-8fc1-41f2-a19f-6c916a5758fd service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:56:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-abc26266-8b5f-4132-bb1a-93a34915f4b4 req-ecd22154-8fc1-41f2-a19f-6c916a5758fd service nova] Acquiring lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-abc26266-8b5f-4132-bb1a-93a34915f4b4 req-ecd22154-8fc1-41f2-a19f-6c916a5758fd service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-abc26266-8b5f-4132-bb1a-93a34915f4b4 req-ecd22154-8fc1-41f2-a19f-6c916a5758fd service nova] Lock "34141f58-5c62-4245-bd2a-06d4e4518529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-abc26266-8b5f-4132-bb1a-93a34915f4b4 req-ecd22154-8fc1-41f2-a19f-6c916a5758fd service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] No waiting events found dispatching network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:56:23 user nova-compute[73029]: WARNING nova.compute.manager [req-abc26266-8b5f-4132-bb1a-93a34915f4b4 req-ecd22154-8fc1-41f2-a19f-6c916a5758fd service nova] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Received unexpected event network-vif-plugged-e5a3d05c-7b55-4c15-9928-da308650b378 for instance with vm_state deleted and task_state None.
Aug 10 00:56:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 00:56:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 00:56:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updating instance_info_cache with network_info: [{"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-a2f85a2f-0bb4-4020-9260-98f866f5c9f6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:56:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:56:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691628981.3643928, 34141f58-5c62-4245-bd2a-06d4e4518529 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:56:36 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] VM Stopped (Lifecycle Event)
Aug 10 00:56:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-b0d64a28-45ad-4c0f-a70f-31046acfa317 None None] [instance: 34141f58-5c62-4245-bd2a-06d4e4518529] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:56:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:56:37 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:56:37 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8098MB free_disk=25.108104705810547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a5068df0-a174-41d9-b6db-e992bc1fba19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:56:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:56:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "a5068df0-a174-41d9-b6db-e992bc1fba19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:40 user nova-compute[73029]: INFO nova.compute.manager [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Terminating instance
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-cd75a1cb-f1a0-4bfc-a391-9d29740e13d8 req-29273329-1fc3-454c-b44b-4eb5fac09cbb service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received event network-vif-unplugged-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cd75a1cb-f1a0-4bfc-a391-9d29740e13d8 req-29273329-1fc3-454c-b44b-4eb5fac09cbb service nova] Acquiring lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cd75a1cb-f1a0-4bfc-a391-9d29740e13d8 req-29273329-1fc3-454c-b44b-4eb5fac09cbb service nova] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cd75a1cb-f1a0-4bfc-a391-9d29740e13d8 req-29273329-1fc3-454c-b44b-4eb5fac09cbb service nova] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-cd75a1cb-f1a0-4bfc-a391-9d29740e13d8 req-29273329-1fc3-454c-b44b-4eb5fac09cbb service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] No waiting events found dispatching network-vif-unplugged-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-cd75a1cb-f1a0-4bfc-a391-9d29740e13d8 req-29273329-1fc3-454c-b44b-4eb5fac09cbb service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received event network-vif-unplugged-328cb765-618d-49bd-9254-9d57fb7a4010 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:40 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Instance destroyed successfully.
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.objects.instance [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lazy-loading 'resources' on Instance uuid a5068df0-a174-41d9-b6db-e992bc1fba19 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1335689954',display_name='tempest-ServersNegativeTestJSON-server-1335689954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1335689954',id=33,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:54:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0830285a49344db872f7606cc837795',ramdisk_id='',reservation_id='r-2fk572d3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-533946204',owner_user_name='tempest-ServersNegativeTestJSON-533946204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:54:56Z,user_data=None,user_id='e4e4682fd39448e5b08386bec3de4b22',uuid=a5068df0-a174-41d9-b6db-e992bc1fba19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converting VIF {"id": "328cb765-618d-49bd-9254-9d57fb7a4010", "address": "fa:16:3e:96:3e:28", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328cb765-61", "ovs_interfaceid": "328cb765-618d-49bd-9254-9d57fb7a4010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=328cb765-618d-49bd-9254-9d57fb7a4010,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328cb765-61') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG os_vif [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=328cb765-618d-49bd-9254-9d57fb7a4010,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328cb765-61') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap328cb765-61, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:40 user nova-compute[73029]: INFO os_vif [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=328cb765-618d-49bd-9254-9d57fb7a4010,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328cb765-61')
Aug 10 00:56:40 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Deleting instance files /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19_del
Aug 10 00:56:40 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Deletion of /opt/stack/data/nova/instances/a5068df0-a174-41d9-b6db-e992bc1fba19_del complete
Aug 10 00:56:40 user nova-compute[73029]: INFO nova.compute.manager [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 10 00:56:40 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:56:40 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:56:41 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:56:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-9da61ec9-8fea-4a50-8fb1-056c5c90b65e req-96509d01-3f40-4e15-b036-ac2383409314 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received event network-vif-deleted-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:56:41 user nova-compute[73029]: INFO nova.compute.manager [req-9da61ec9-8fea-4a50-8fb1-056c5c90b65e req-96509d01-3f40-4e15-b036-ac2383409314 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Neutron deleted interface 328cb765-618d-49bd-9254-9d57fb7a4010; detaching it from the instance and deleting it from the info cache
Aug 10 00:56:41 user nova-compute[73029]: DEBUG nova.network.neutron [req-9da61ec9-8fea-4a50-8fb1-056c5c90b65e req-96509d01-3f40-4e15-b036-ac2383409314 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:56:41 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Took 0.48 seconds to deallocate network for instance.
Aug 10 00:56:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-9da61ec9-8fea-4a50-8fb1-056c5c90b65e req-96509d01-3f40-4e15-b036-ac2383409314 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Detach interface failed, port_id=328cb765-618d-49bd-9254-9d57fb7a4010, reason: Instance a5068df0-a174-41d9-b6db-e992bc1fba19 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 00:56:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:41 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:56:41 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:56:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:41 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Deleted allocations for instance a5068df0-a174-41d9-b6db-e992bc1fba19
Aug 10 00:56:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-83a2ba23-7d1a-42ed-a972-ee3895ba5328 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.761s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-98b1192c-53a9-4399-b12e-328d72cbd638 req-8fef45ee-4917-43df-b163-2529dd5e91e6 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received event network-vif-plugged-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:56:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-98b1192c-53a9-4399-b12e-328d72cbd638 req-8fef45ee-4917-43df-b163-2529dd5e91e6 service nova] Acquiring lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:56:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-98b1192c-53a9-4399-b12e-328d72cbd638 req-8fef45ee-4917-43df-b163-2529dd5e91e6 service nova] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:56:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-98b1192c-53a9-4399-b12e-328d72cbd638 req-8fef45ee-4917-43df-b163-2529dd5e91e6 service nova] Lock "a5068df0-a174-41d9-b6db-e992bc1fba19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:56:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-98b1192c-53a9-4399-b12e-328d72cbd638 req-8fef45ee-4917-43df-b163-2529dd5e91e6 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] No waiting events found dispatching network-vif-plugged-328cb765-618d-49bd-9254-9d57fb7a4010 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:56:42 user nova-compute[73029]: WARNING nova.compute.manager [req-98b1192c-53a9-4399-b12e-328d72cbd638 req-8fef45ee-4917-43df-b163-2529dd5e91e6 service nova] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Received unexpected event network-vif-plugged-328cb765-618d-49bd-9254-9d57fb7a4010 for instance with vm_state deleted and task_state None.
Aug 10 00:56:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:56:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:56:55 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629000.8104463, a5068df0-a174-41d9-b6db-e992bc1fba19 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:56:55 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] VM Stopped (Lifecycle Event)
Aug 10 00:56:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0e191dac-b3ee-45c3-8c97-ceccb0c0eeb6 None None] [instance: a5068df0-a174-41d9-b6db-e992bc1fba19] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:56:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:57:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG nova.objects.instance [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:03 user nova-compute[73029]: INFO nova.compute.manager [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attaching volume b8605f64-ce43-4e42-98c3-9be503cc05f5 to /dev/vdb
Aug 10 00:57:03 user nova-compute[73029]: DEBUG os_brick.utils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a6b9b4-3422-413a-b1cb-fb1e60337162]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b6503d-8ecc-4f22-becb-4da6a8089470]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dbeb99-a9cb-4396-a746-b5f585c16ed3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9307f0f8-6a5e-47c9-8060-301d45423a24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:57:04 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:57:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2a1ad0-450a-4102-b27e-6b80a43b62b4]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG os_brick.utils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:57:04 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updating existing volume attachment record: d050b7c1-547d-4aca-bf22-1d2f28d3bf5b {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:57:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:57:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:11 user nova-compute[73029]: INFO nova.compute.manager [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Terminating instance
Aug 10 00:57:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-75690508-9776-4c72-9703-077239bef4bd req-3ede2a19-fb2a-49fb-b895-a095bd05e18d service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-unplugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-75690508-9776-4c72-9703-077239bef4bd req-3ede2a19-fb2a-49fb-b895-a095bd05e18d service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-75690508-9776-4c72-9703-077239bef4bd req-3ede2a19-fb2a-49fb-b895-a095bd05e18d service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-75690508-9776-4c72-9703-077239bef4bd req-3ede2a19-fb2a-49fb-b895-a095bd05e18d service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-75690508-9776-4c72-9703-077239bef4bd req-3ede2a19-fb2a-49fb-b895-a095bd05e18d service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-unplugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:57:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-75690508-9776-4c72-9703-077239bef4bd req-3ede2a19-fb2a-49fb-b895-a095bd05e18d service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-unplugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 00:57:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Instance destroyed successfully.
Aug 10 00:57:12 user nova-compute[73029]: DEBUG nova.objects.instance [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lazy-loading 'resources' on Instance uuid a2f85a2f-0bb4-4020-9260-98f866f5c9f6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:40:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-405003104',display_name='tempest-ServerRescueNegativeTestJSON-server-405003104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-405003104',id=16,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:44:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e54d7ee7b2c741e2bbc4a1fb4a2cc042',ramdisk_id='',reservation_id='r-9awclp1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1160585559',owner_user_name='tempest-ServerRescueNegativeTestJSON-1160585559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:46:47Z,user_data=None,user_id='4a4fb6b058c64442b1688a3962849322',uuid=a2f85a2f-0bb4-4020-9260-98f866f5c9f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converting VIF {"id": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "address": "fa:16:3e:be:61:2e", "network": {"id": "c2952786-54bd-44b3-99fc-8e8cff9177e0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-820125943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54d7ee7b2c741e2bbc4a1fb4a2cc042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb034f0-40", "ovs_interfaceid": "3eb034f0-40de-4c90-aaa8-5a9afdf3461c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:61:2e,bridge_name='br-int',has_traffic_filtering=True,id=3eb034f0-40de-4c90-aaa8-5a9afdf3461c,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb034f0-40') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_vif [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:61:2e,bridge_name='br-int',has_traffic_filtering=True,id=3eb034f0-40de-4c90-aaa8-5a9afdf3461c,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb034f0-40') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eb034f0-40, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:57:12 user nova-compute[73029]: INFO os_vif [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:61:2e,bridge_name='br-int',has_traffic_filtering=True,id=3eb034f0-40de-4c90-aaa8-5a9afdf3461c,network=Network(c2952786-54bd-44b3-99fc-8e8cff9177e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb034f0-40')
Aug 10 00:57:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Deleting instance files /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6_del
Aug 10 00:57:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Deletion of /opt/stack/data/nova/instances/a2f85a2f-0bb4-4020-9260-98f866f5c9f6_del complete
Aug 10 00:57:12 user nova-compute[73029]: INFO nova.compute.manager [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HowSJUyZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:57:12 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:57:12 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:57:12 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[587b9994-e1cc-4080-96c9-aa811b3fb218]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:57:12 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf922ad-740f-497f-9f68-1033410fbfeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5] added
Aug 10 00:57:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1d0492-361f-483c-9e44-c26a9a65d716]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6531aa3-b16b-4867-88ef-ccb74192865a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HowSJUyZ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HowSJUyZ" returned: 0 in 0.124s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea44bfb7-7190-4aa9-9d6b-34da501af3a9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HowSJUyZ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c81371-5886-4589-9b30-0d10d546fce6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Took 0.62 seconds to deallocate network for instance.
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f794cc-3eea-468f-ad55-dd443cf34438]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:57:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:57:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4f5bee-b652-4eeb-ad14-8d4565919a9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5, portal: 172.16.0.220,3260]
Aug 10 00:57:12 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5, portal: 172.16.0.220,3260] successful.
Aug 10 00:57:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f811e5d8-9b3d-4ee7-81df-2587c18a9b74]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cf5bed-18a1-41e1-9df8-cbf6fb0be206]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:57:12 user nova-compute[73029]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 (non-flash)
Aug 10 00:57:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:57:12 user nova-compute[73029]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 (non-flash)
Aug 10 00:57:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af0fb13-036b-44fb-8fe7-fc79c4a01835]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:57:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HowSJUyZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:13 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Deleted allocations for instance a2f85a2f-0bb4-4020-9260-98f866f5c9f6
Aug 10 00:57:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7fa94319-b3c0-4736-af31-65aa20e61458 tempest-ServerRescueNegativeTestJSON-1160585559 tempest-ServerRescueNegativeTestJSON-1160585559-project-member] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.903s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c42286d-b325-436e-8f1a-9142eb09f9af req-f30bab19-f68c-420e-858d-4e7d7d9b7a25 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c42286d-b325-436e-8f1a-9142eb09f9af req-f30bab19-f68c-420e-858d-4e7d7d9b7a25 service nova] Acquiring lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c42286d-b325-436e-8f1a-9142eb09f9af req-f30bab19-f68c-420e-858d-4e7d7d9b7a25 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c42286d-b325-436e-8f1a-9142eb09f9af req-f30bab19-f68c-420e-858d-4e7d7d9b7a25 service nova] Lock "a2f85a2f-0bb4-4020-9260-98f866f5c9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c42286d-b325-436e-8f1a-9142eb09f9af req-f30bab19-f68c-420e-858d-4e7d7d9b7a25 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] No waiting events found dispatching network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:57:13 user nova-compute[73029]: WARNING nova.compute.manager [req-4c42286d-b325-436e-8f1a-9142eb09f9af req-f30bab19-f68c-420e-858d-4e7d7d9b7a25 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received unexpected event network-vif-plugged-3eb034f0-40de-4c90-aaa8-5a9afdf3461c for instance with vm_state deleted and task_state None.
Aug 10 00:57:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c42286d-b325-436e-8f1a-9142eb09f9af req-f30bab19-f68c-420e-858d-4e7d7d9b7a25 service nova] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Received event network-vif-deleted-3eb034f0-40de-4c90-aaa8-5a9afdf3461c {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26664306332316536', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664306332316536', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG nova.objects.instance [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:57:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:57:13 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:57:13 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:57:13 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:57:13 user nova-compute[73029]:   <serial>b8605f64-ce43-4e42-98c3-9be503cc05f5</serial>
Aug 10 00:57:13 user nova-compute[73029]: </disk>
Aug 10 00:57:13 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:57:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:57:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:57:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No VIF found with MAC fa:16:3e:fd:b9:fa, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:57:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92fa191a-0c99-4639-ad1e-9dc7542879e2 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.577s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:16 user nova-compute[73029]: INFO nova.compute.manager [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Detaching volume b8605f64-ce43-4e42-98c3-9be503cc05f5
Aug 10 00:57:16 user nova-compute[73029]: INFO nova.virt.block_device [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attempting to driver detach volume b8605f64-ce43-4e42-98c3-9be503cc05f5 from mountpoint /dev/vdb
Aug 10 00:57:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Attempting to detach device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:57:16 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:57:16 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:57:16 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:57:16 user nova-compute[73029]:   <serial>b8605f64-ce43-4e42-98c3-9be503cc05f5</serial>
Aug 10 00:57:16 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:57:16 user nova-compute[73029]: </disk>
Aug 10 00:57:16 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:57:16 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully detached device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the persistent domain config.
Aug 10 00:57:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:57:16 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:57:16 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:57:16 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:57:16 user nova-compute[73029]:   <serial>b8605f64-ce43-4e42-98c3-9be503cc05f5</serial>
Aug 10 00:57:16 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:57:16 user nova-compute[73029]: </disk>
Aug 10 00:57:16 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691629036.633139, cd1ef428-2411-4cb8-bccd-7741e05e1a50 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:57:16 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully detached device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the live domain config.
Aug 10 00:57:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HowSJUyZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:57:16 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f9bcc3-9595-48b4-8d43-82e86ecc3b8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dfccb5-5557-4fe7-a9a0-53669946f73c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:57:16 user nova-compute[73029]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 (non-flash)
Aug 10 00:57:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:57:16 user nova-compute[73029]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 (non-flash)
Aug 10 00:57:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7528c73760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d977bf93-cf14-438a-b355-5b79fd421d40]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14f0ce0-e4f5-47b2-915f-f1644fde7f6a]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[06681f1a-2f3d-4360-a199-ae61e311de33]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88db1c0-2ddb-45da-83c3-e872a8971c3d]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec51c9-b671-41d4-a8c1-8bc0fdd3334b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[52edf51e-0f89-4db9-905c-c92631d7ec10]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5, portal: 172.16.0.220,3260]
Aug 10 00:57:16 user nova-compute[73029]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5, portal: 172.16.0.220,3260] successful.
Aug 10 00:57:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8605f64-ce43-4e42-98c3-9be503cc05f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8468bd1-bb8f-4b7c-a997-8ea4098916fc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== disconnect_volume: return (262ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:57:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:57:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:57:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c660a94a-426e-43ee-9a91-83789fb4a0ee tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.545s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:27 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629032.0258045, a2f85a2f-0bb4-4020-9260-98f866f5c9f6 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:57:27 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] VM Stopped (Lifecycle Event)
Aug 10 00:57:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0cc586f3-66b3-4e9a-b0d2-699a030c4877 None None] [instance: a2f85a2f-0bb4-4020-9260-98f866f5c9f6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:57:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:57:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:57:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:57:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:57:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updating instance_info_cache with network_info: [{"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:57:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:57:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:57:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:57:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8382MB free_disk=25.162578582763672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:36 user nova-compute[73029]: INFO nova.compute.manager [None req-71fa7a77-583e-498e-af27-cb2bd249594d tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Unrescuing
Aug 10 00:57:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-71fa7a77-583e-498e-af27-cb2bd249594d tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-71fa7a77-583e-498e-af27-cb2bd249594d tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquired lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-71fa7a77-583e-498e-af27-cb2bd249594d tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:57:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-71fa7a77-583e-498e-af27-cb2bd249594d tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updating instance_info_cache with network_info: [{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-71fa7a77-583e-498e-af27-cb2bd249594d tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Releasing lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG nova.objects.instance [None req-71fa7a77-583e-498e-af27-cb2bd249594d tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'flavor' on Instance uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-312a2e0d-af4d-485b-baa9-eec2b4e0a47b req-925def8f-0e32-4978-bd99-8eff6208c39d service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-unplugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-312a2e0d-af4d-485b-baa9-eec2b4e0a47b req-925def8f-0e32-4978-bd99-8eff6208c39d service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-312a2e0d-af4d-485b-baa9-eec2b4e0a47b req-925def8f-0e32-4978-bd99-8eff6208c39d service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-312a2e0d-af4d-485b-baa9-eec2b4e0a47b req-925def8f-0e32-4978-bd99-8eff6208c39d service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-312a2e0d-af4d-485b-baa9-eec2b4e0a47b req-925def8f-0e32-4978-bd99-8eff6208c39d service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-unplugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:57:37 user nova-compute[73029]: WARNING nova.compute.manager [req-312a2e0d-af4d-485b-baa9-eec2b4e0a47b req-925def8f-0e32-4978-bd99-8eff6208c39d service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-unplugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:57:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:37 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Instance destroyed successfully.
Aug 10 00:57:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:57:39 user nova-compute[73029]: WARNING nova.compute.manager [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:57:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:57:39 user nova-compute[73029]: WARNING nova.compute.manager [req-46ba087e-315d-404a-b712-311e78e9ab7a req-4b19adba-f9d4-4006-a0ad-7f0556616ce1 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state rescued and task_state unrescuing.
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 3d6ce28c-39f0-432c-bfe3-a5891fb69021 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629061.348837, 3d6ce28c-39f0-432c-bfe3-a5891fb69021 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:57:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] VM Resumed (Lifecycle Event)
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-71fa7a77-583e-498e-af27-cb2bd249594d tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:57:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629061.3515244, 3d6ce28c-39f0-432c-bfe3-a5891fb69021 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:57:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] VM Started (Lifecycle Event)
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-bb22b1e1-0247-4bc7-a6a1-4cf1d40fd1e5 req-d5cb3602-7c62-455c-a772-27d6ba6a9829 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:57:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bb22b1e1-0247-4bc7-a6a1-4cf1d40fd1e5 req-d5cb3602-7c62-455c-a772-27d6ba6a9829 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:57:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bb22b1e1-0247-4bc7-a6a1-4cf1d40fd1e5 req-d5cb3602-7c62-455c-a772-27d6ba6a9829 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:57:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bb22b1e1-0247-4bc7-a6a1-4cf1d40fd1e5 req-d5cb3602-7c62-455c-a772-27d6ba6a9829 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:57:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-bb22b1e1-0247-4bc7-a6a1-4cf1d40fd1e5 req-d5cb3602-7c62-455c-a772-27d6ba6a9829 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:57:41 user nova-compute[73029]: WARNING nova.compute.manager [req-bb22b1e1-0247-4bc7-a6a1-4cf1d40fd1e5 req-d5cb3602-7c62-455c-a772-27d6ba6a9829 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state active and task_state None.
Aug 10 00:57:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:57:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:57:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:57:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:57:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:57:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:58:10 user nova-compute[73029]: INFO nova.compute.manager [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attaching volume 71158c5d-ff02-4f2f-b815-0fed173c1e9b to /dev/vdb
Aug 10 00:58:10 user nova-compute[73029]: DEBUG os_brick.utils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419bb5a-dfad-4af2-a291-9e9a66f4a5a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e28ca13-19cf-4283-a07c-ebcb383feaec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95a1ef-0bba-4435-9244-c104cf4e84b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf0cb7e-751b-4853-8b0d-9bc2cc49ea1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:58:10 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:58:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e4f1cd-45a4-4c54-9ba6-91b3091c5a1f]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG os_brick.utils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:58:10 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updating existing volume attachment record: 38cce396-d194-43fd-99c7-b3db817af09e {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:58:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:58:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwkcgMbr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:58:19 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:58:19 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:58:19 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4daa011-2031-4f7a-be15-502f354eebe5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:58:19 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab08359c-022d-4755-ab67-6e431fdd574d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b] added
Aug 10 00:58:19 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3364c7e-3a8a-47d9-99b5-b3e0c7f564d4]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f7e051-2c60-4213-ba25-7badc0674685]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YwkcgMbr {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YwkcgMbr" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b40ccf8-9b52-424b-9443-59f254c413ef]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YwkcgMbr'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2acf885-7a2b-4a65-aaf7-644828e7025f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be9f732-0873-4329-aa70-e19ec5491b75]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:58:19 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:58:19 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bdf2c2-3140-482a-a3ab-fa3fece1ad29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b, portal: 172.16.0.220,3260]
Aug 10 00:58:19 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b, portal: 172.16.0.220,3260] successful.
Aug 10 00:58:19 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82e2b94-311f-401f-a616-f729329f3f5c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebbdd54-b327-41a1-9d88-af72e1541592]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:58:19 user nova-compute[73029]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b (non-flash)
Aug 10 00:58:19 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:58:19 user nova-compute[73029]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b (non-flash)
Aug 10 00:58:19 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8d8ba8-be1d-4566-bb54-7909b5bdbf46]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:19 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwkcgMbr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23838613066393132', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838613066393132', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:58:20 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:58:20 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:58:20 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:58:20 user nova-compute[73029]:   <serial>71158c5d-ff02-4f2f-b815-0fed173c1e9b</serial>
Aug 10 00:58:20 user nova-compute[73029]: </disk>
Aug 10 00:58:20 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No VIF found with MAC fa:16:3e:fd:b9:fa, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:58:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d37f6f5b-44a8-43cb-9bc3-d65fdf5cdf66 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.477s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:58:22 user nova-compute[73029]: INFO nova.compute.manager [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Detaching volume 71158c5d-ff02-4f2f-b815-0fed173c1e9b
Aug 10 00:58:22 user nova-compute[73029]: INFO nova.virt.block_device [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attempting to driver detach volume 71158c5d-ff02-4f2f-b815-0fed173c1e9b from mountpoint /dev/vdb
Aug 10 00:58:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Attempting to detach device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:58:22 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:58:22 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:58:22 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:58:22 user nova-compute[73029]:   <serial>71158c5d-ff02-4f2f-b815-0fed173c1e9b</serial>
Aug 10 00:58:22 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:58:22 user nova-compute[73029]: </disk>
Aug 10 00:58:22 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:58:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully detached device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the persistent domain config.
Aug 10 00:58:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:58:22 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:58:22 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:58:22 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:58:22 user nova-compute[73029]:   <serial>71158c5d-ff02-4f2f-b815-0fed173c1e9b</serial>
Aug 10 00:58:22 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:58:22 user nova-compute[73029]: </disk>
Aug 10 00:58:22 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:58:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691629103.1509435, cd1ef428-2411-4cb8-bccd-7741e05e1a50 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:58:23 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully detached device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the live domain config.
Aug 10 00:58:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwkcgMbr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:58:23 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1894fdc6-2388-47fe-9b7e-1ced599ab1d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a42d8-04b4-4419-bf05-3313e4183170]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:58:23 user nova-compute[73029]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b (non-flash)
Aug 10 00:58:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:58:23 user nova-compute[73029]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b (non-flash)
Aug 10 00:58:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f0711ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4501e9a7-1281-4fdc-afa4-e0eb51b64caf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa90c8d7-fff8-412a-b350-dcd04c5c6304]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0410d00d-f461-4d6d-a523-35e97168ef32]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7214783-c932-48f0-89da-f3912f4a2c1e]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeba52ba-92d8-4be2-9261-f459e26ed24a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9c60b6-3deb-4fbd-9871-ef0de4abaf60]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b, portal: 172.16.0.220,3260]
Aug 10 00:58:23 user nova-compute[73029]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b, portal: 172.16.0.220,3260] successful.
Aug 10 00:58:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71158c5d-ff02-4f2f-b815-0fed173c1e9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0df02f-02f2-43f3-aedd-c2bd08d013e4]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== disconnect_volume: return (274ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:58:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:58:24 user nova-compute[73029]: DEBUG nova.objects.instance [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:58:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-754bf800-51d2-4208-a1e5-905471b8435d tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:58:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:58:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:58:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Updating instance_info_cache with network_info: [{"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:58:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:58:34 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:38 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:58:38 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=25.161376953125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:58:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:58:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:58:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:58:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:58:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:58:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:58:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:58:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:58:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:58:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:58:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 00:58:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:58:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 00:58:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:59:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:16 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:59:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:17 user nova-compute[73029]: INFO nova.compute.manager [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attaching volume 66651093-ecd5-4669-8041-a80c119700aa to /dev/vdb
Aug 10 00:59:17 user nova-compute[73029]: DEBUG os_brick.utils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4b4455-8960-4846-b61c-2857011afab7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b07624-d3c8-4076-ac0d-9a58df20b681]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[612d2f90-9e2e-4a7b-84c1-33e79afd2f6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccd59c6-b49d-46bf-a03d-39733a17481b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 00:59:17 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 00:59:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[829edeb5-d705-47c7-b8f6-741c3847f8f7]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG os_brick.utils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updating existing volume attachment record: 3e0045b6-bc65-4556-ba24-0cdde8bed875 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 00:59:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:59:19 user nova-compute[73029]: INFO nova.compute.claims [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Claim successful on node user
Aug 10 00:59:19 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:59:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:59:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:59:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG nova.policy [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e642789003f549d0ae27ed2d59e5d83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280502c983b740e4b70c15c433d3af93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:59:20 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Creating image(s)
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "/opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "/opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "/opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.148s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk 1073741824" returned: 0 in 0.045s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.129s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Cannot resize image /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG nova.objects.instance [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lazy-loading 'migration_context' on Instance uuid 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Ensure instance console log exists: /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Successfully created port: 8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:59:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Successfully updated port: 8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:59:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "refresh_cache-35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:59:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquired lock "refresh_cache-35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:59:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:59:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-d4400c20-b4b5-4228-9e66-f3473fd35e3a req-63f29733-a521-436e-9e8d-59bf8e01fb6c service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received event network-changed-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:59:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-d4400c20-b4b5-4228-9e66-f3473fd35e3a req-63f29733-a521-436e-9e8d-59bf8e01fb6c service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Refreshing instance network info cache due to event network-changed-8a355b8f-d4e5-4cd1-8e79-5f89027db341. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:59:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d4400c20-b4b5-4228-9e66-f3473fd35e3a req-63f29733-a521-436e-9e8d-59bf8e01fb6c service nova] Acquiring lock "refresh_cache-35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:59:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.network.neutron [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Updating instance_info_cache with network_info: [{"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Releasing lock "refresh_cache-35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Instance network_info: |[{"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d4400c20-b4b5-4228-9e66-f3473fd35e3a req-63f29733-a521-436e-9e8d-59bf8e01fb6c service nova] Acquired lock "refresh_cache-35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-d4400c20-b4b5-4228-9e66-f3473fd35e3a req-63f29733-a521-436e-9e8d-59bf8e01fb6c service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Refreshing network info cache for port 8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Start _get_guest_xml network_info=[{"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:59:22 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:59:22 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173680949',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173680949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1173680',id=34,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7N2t45ttRtuO6MiF/zrwnL3qgFew5g7IBsPN0DcZQPHayA3IHBVh67pZmZgvFbl0VZG5Fdu2E7/7l6kHgdcEDMlr2xkHcUNzLgzefIXUbKM3jqjpt0Z0YIsRcQ/ajfog==',key_name='tempest-keypair-1847549140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280502c983b740e4b70c15c433d3af93',ramdisk_id='',reservation_id='r-o4azcbi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-834894433',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e642789003f549d0ae27ed2d59e5d83f',uuid=35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Converting VIF {"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=8a355b8f-d4e5-4cd1-8e79-5f89027db341,network=Network(17fa8dd9-bf32-450b-9992-f697628a45e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a355b8f-d4') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.objects.instance [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lazy-loading 'pci_devices' on Instance uuid 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:59:22 user nova-compute[73029]:   <uuid>35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06</uuid>
Aug 10 00:59:22 user nova-compute[73029]:   <name>instance-00000022</name>
Aug 10 00:59:22 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:59:22 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:59:22 user nova-compute[73029]:   <metadata>
Aug 10 00:59:22 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:59:22 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:59:22 user nova-compute[73029]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1173680949</nova:name>
Aug 10 00:59:22 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:59:22</nova:creationTime>
Aug 10 00:59:22 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:59:22 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:59:22 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:59:22 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:59:22 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:59:22 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:59:22 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:59:22 user nova-compute[73029]:       <nova:owner>
Aug 10 00:59:22 user nova-compute[73029]:         <nova:user uuid="e642789003f549d0ae27ed2d59e5d83f">tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member</nova:user>
Aug 10 00:59:22 user nova-compute[73029]:         <nova:project uuid="280502c983b740e4b70c15c433d3af93">tempest-TestServerVolumeAttachScenarioOldVersion-834894433</nova:project>
Aug 10 00:59:22 user nova-compute[73029]:       </nova:owner>
Aug 10 00:59:22 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:59:22 user nova-compute[73029]:       <nova:ports>
Aug 10 00:59:22 user nova-compute[73029]:         <nova:port uuid="8a355b8f-d4e5-4cd1-8e79-5f89027db341">
Aug 10 00:59:22 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 00:59:22 user nova-compute[73029]:         </nova:port>
Aug 10 00:59:22 user nova-compute[73029]:       </nova:ports>
Aug 10 00:59:22 user nova-compute[73029]:     </nova:instance>
Aug 10 00:59:22 user nova-compute[73029]:   </metadata>
Aug 10 00:59:22 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:59:22 user nova-compute[73029]:     <system>
Aug 10 00:59:22 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:59:22 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:59:22 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:59:22 user nova-compute[73029]:       <entry name="serial">35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06</entry>
Aug 10 00:59:22 user nova-compute[73029]:       <entry name="uuid">35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06</entry>
Aug 10 00:59:22 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:59:22 user nova-compute[73029]:     </system>
Aug 10 00:59:22 user nova-compute[73029]:   </sysinfo>
Aug 10 00:59:22 user nova-compute[73029]:   <os>
Aug 10 00:59:22 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:59:22 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:59:22 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:59:22 user nova-compute[73029]:   </os>
Aug 10 00:59:22 user nova-compute[73029]:   <features>
Aug 10 00:59:22 user nova-compute[73029]:     <acpi/>
Aug 10 00:59:22 user nova-compute[73029]:     <apic/>
Aug 10 00:59:22 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:59:22 user nova-compute[73029]:   </features>
Aug 10 00:59:22 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:59:22 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:59:22 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:59:22 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:59:22 user nova-compute[73029]:   </clock>
Aug 10 00:59:22 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:59:22 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:59:22 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:59:22 user nova-compute[73029]:   </cpu>
Aug 10 00:59:22 user nova-compute[73029]:   <devices>
Aug 10 00:59:22 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:59:22 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:59:22 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk"/>
Aug 10 00:59:22 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:59:22 user nova-compute[73029]:     </disk>
Aug 10 00:59:22 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:59:22 user nova-compute[73029]:       <mac address="fa:16:3e:c6:0c:c9"/>
Aug 10 00:59:22 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:59:22 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:59:22 user nova-compute[73029]:       <target dev="tap8a355b8f-d4"/>
Aug 10 00:59:22 user nova-compute[73029]:     </interface>
Aug 10 00:59:22 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:59:22 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/console.log" append="off"/>
Aug 10 00:59:22 user nova-compute[73029]:     </serial>
Aug 10 00:59:22 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:59:22 user nova-compute[73029]:     <video>
Aug 10 00:59:22 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:59:22 user nova-compute[73029]:     </video>
Aug 10 00:59:22 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:59:22 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:59:22 user nova-compute[73029]:     </rng>
Aug 10 00:59:22 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:59:22 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:59:22 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:59:22 user nova-compute[73029]:     </memballoon>
Aug 10 00:59:22 user nova-compute[73029]:   </devices>
Aug 10 00:59:22 user nova-compute[73029]: </domain>
Aug 10 00:59:22 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173680949',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173680949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1173680',id=34,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7N2t45ttRtuO6MiF/zrwnL3qgFew5g7IBsPN0DcZQPHayA3IHBVh67pZmZgvFbl0VZG5Fdu2E7/7l6kHgdcEDMlr2xkHcUNzLgzefIXUbKM3jqjpt0Z0YIsRcQ/ajfog==',key_name='tempest-keypair-1847549140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280502c983b740e4b70c15c433d3af93',ramdisk_id='',reservation_id='r-o4azcbi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-834894433',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e642789003f549d0ae27ed2d59e5d83f',uuid=35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Converting VIF {"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=8a355b8f-d4e5-4cd1-8e79-5f89027db341,network=Network(17fa8dd9-bf32-450b-9992-f697628a45e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a355b8f-d4') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG os_vif [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=8a355b8f-d4e5-4cd1-8e79-5f89027db341,network=Network(17fa8dd9-bf32-450b-9992-f697628a45e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a355b8f-d4') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a355b8f-d4, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a355b8f-d4, col_values=(('external_ids', {'iface-id': '8a355b8f-d4e5-4cd1-8e79-5f89027db341', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:0c:c9', 'vm-uuid': '35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:22 user nova-compute[73029]: INFO os_vif [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=8a355b8f-d4e5-4cd1-8e79-5f89027db341,network=Network(17fa8dd9-bf32-450b-9992-f697628a45e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a355b8f-d4')
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] No VIF found with MAC fa:16:3e:c6:0c:c9, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-d4400c20-b4b5-4228-9e66-f3473fd35e3a req-63f29733-a521-436e-9e8d-59bf8e01fb6c service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Updated VIF entry in instance network info cache for port 8a355b8f-d4e5-4cd1-8e79-5f89027db341. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-d4400c20-b4b5-4228-9e66-f3473fd35e3a req-63f29733-a521-436e-9e8d-59bf8e01fb6c service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Updating instance_info_cache with network_info: [{"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d4400c20-b4b5-4228-9e66-f3473fd35e3a req-63f29733-a521-436e-9e8d-59bf8e01fb6c service nova] Releasing lock "refresh_cache-35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:59:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-9d35d252-7c99-4053-b1af-6cca7068f2b2 req-91cb460c-eee6-495a-9b7c-48fc7f6332b7 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received event network-vif-plugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:59:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9d35d252-7c99-4053-b1af-6cca7068f2b2 req-91cb460c-eee6-495a-9b7c-48fc7f6332b7 service nova] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9d35d252-7c99-4053-b1af-6cca7068f2b2 req-91cb460c-eee6-495a-9b7c-48fc7f6332b7 service nova] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9d35d252-7c99-4053-b1af-6cca7068f2b2 req-91cb460c-eee6-495a-9b7c-48fc7f6332b7 service nova] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-9d35d252-7c99-4053-b1af-6cca7068f2b2 req-91cb460c-eee6-495a-9b7c-48fc7f6332b7 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] No waiting events found dispatching network-vif-plugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:59:23 user nova-compute[73029]: WARNING nova.compute.manager [req-9d35d252-7c99-4053-b1af-6cca7068f2b2 req-91cb460c-eee6-495a-9b7c-48fc7f6332b7 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received unexpected event network-vif-plugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 for instance with vm_state building and task_state spawning.
Aug 10 00:59:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629165.6179173, 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:59:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] VM Resumed (Lifecycle Event)
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:59:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Instance spawned successfully.
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629165.6211667, 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:59:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] VM Started (Lifecycle Event)
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:59:25 user nova-compute[73029]: INFO nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:59:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:59:25 user nova-compute[73029]: INFO nova.compute.manager [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Took 6.54 seconds to build instance.
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-75a42987-ccaa-419d-821a-5ee13bd9ca2a tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.654s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-1cc2c142-0282-4c27-955c-b219b90f8d4a req-4b8b05f5-7e5d-4794-a5b6-4b733469f5b0 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received event network-vif-plugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1cc2c142-0282-4c27-955c-b219b90f8d4a req-4b8b05f5-7e5d-4794-a5b6-4b733469f5b0 service nova] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1cc2c142-0282-4c27-955c-b219b90f8d4a req-4b8b05f5-7e5d-4794-a5b6-4b733469f5b0 service nova] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1cc2c142-0282-4c27-955c-b219b90f8d4a req-4b8b05f5-7e5d-4794-a5b6-4b733469f5b0 service nova] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-1cc2c142-0282-4c27-955c-b219b90f8d4a req-4b8b05f5-7e5d-4794-a5b6-4b733469f5b0 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] No waiting events found dispatching network-vif-plugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:59:25 user nova-compute[73029]: WARNING nova.compute.manager [req-1cc2c142-0282-4c27-955c-b219b90f8d4a req-4b8b05f5-7e5d-4794-a5b6-4b733469f5b0 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received unexpected event network-vif-plugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 for instance with vm_state active and task_state None.
Aug 10 00:59:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjoBfhEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:59:25 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:59:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:59:25 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:59:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:59:25 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a5ee8b-b415-4012-b36d-badec5d763ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 00:59:25 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[306a3700-860f-4240-b728-8ed8f8ce3d58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa] added
Aug 10 00:59:25 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2af7c6-49d1-4ca1-a1cb-126ea7d38241]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e831d408-daac-404c-bc26-6bfabdd40b7d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjoBfhEQ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjoBfhEQ" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[91189cce-fec4-480f-b3b5-e3d0f22e957c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjoBfhEQ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9244f2a9-d012-4fcc-84c4-d3f4715433d2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be64de7-a1c4-4a5d-aa77-6c0dce7e4ac3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:59:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:59:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed9703d-8585-44c0-a81b-08419c2b8918]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa, portal: 172.16.0.220,3260]
Aug 10 00:59:26 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa, portal: 172.16.0.220,3260] successful.
Aug 10 00:59:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b272ce2c-df82-4e5e-98a6-f43e3a267e88]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30bf259-ef19-44f4-81dd-d744f5e02ad9]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:59:26 user nova-compute[73029]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa (non-flash)
Aug 10 00:59:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:59:26 user nova-compute[73029]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa (non-flash)
Aug 10 00:59:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcae88f6-0db4-4cd4-8771-7aff5d2a303b]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 00:59:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjoBfhEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26236393264373065', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236393264373065', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 00:59:27 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:59:27 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:59:27 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:59:27 user nova-compute[73029]:   <serial>66651093-ecd5-4669-8041-a80c119700aa</serial>
Aug 10 00:59:27 user nova-compute[73029]: </disk>
Aug 10 00:59:27 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] No VIF found with MAC fa:16:3e:fd:b9:fa, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a0b93eff-ff45-4a4d-8c23-f8f4674bd0b5 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.783s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "eb392795-1e14-4753-b0e3-0971ab34e369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "eb392795-1e14-4753-b0e3-0971ab34e369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:28 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 00:59:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:28 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 00:59:28 user nova-compute[73029]: INFO nova.compute.claims [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Claim successful on node user
Aug 10 00:59:28 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 00:59:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.policy [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d34a91746034f349b7eeccfd372f21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39027fdade2f41048db7d3855f3197cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 00:59:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Creating image(s)
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "/opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "/opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk 1073741824" returned: 0 in 0.068s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.161s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Successfully created port: c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Cannot resize image /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.objects.instance [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'migration_context' on Instance uuid eb392795-1e14-4753-b0e3-0971ab34e369 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Ensure instance console log exists: /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:30 user nova-compute[73029]: INFO nova.compute.manager [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Detaching volume 66651093-ecd5-4669-8041-a80c119700aa
Aug 10 00:59:30 user nova-compute[73029]: INFO nova.virt.block_device [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Attempting to driver detach volume 66651093-ecd5-4669-8041-a80c119700aa from mountpoint /dev/vdb
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Attempting to detach device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:59:30 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:59:30 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:59:30 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:59:30 user nova-compute[73029]:   <serial>66651093-ecd5-4669-8041-a80c119700aa</serial>
Aug 10 00:59:30 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:59:30 user nova-compute[73029]: </disk>
Aug 10 00:59:30 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:59:30 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully detached device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the persistent domain config.
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 00:59:30 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 00:59:30 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 00:59:30 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 00:59:30 user nova-compute[73029]:   <serial>66651093-ecd5-4669-8041-a80c119700aa</serial>
Aug 10 00:59:30 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 00:59:30 user nova-compute[73029]: </disk>
Aug 10 00:59:30 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Successfully updated port: c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquired lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-b4f777ac-2a0c-4ce0-9c15-42e6770a6eac req-055f8c52-ce63-4aff-93cd-03be25d0fc87 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received event network-changed-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-b4f777ac-2a0c-4ce0-9c15-42e6770a6eac req-055f8c52-ce63-4aff-93cd-03be25d0fc87 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Refreshing instance network info cache due to event network-changed-c4a926df-e2a2-438f-8953-535e20e82e86. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b4f777ac-2a0c-4ce0-9c15-42e6770a6eac req-055f8c52-ce63-4aff-93cd-03be25d0fc87 service nova] Acquiring lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691629170.948273, cd1ef428-2411-4cb8-bccd-7741e05e1a50 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 00:59:30 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully detached device vdb from instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 from the live domain config.
Aug 10 00:59:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjoBfhEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 00:59:30 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 00:59:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b81f7-ac6e-4b6b-8d92-029b364eb796]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3494465-7d6f-4cbc-a006-b3c599c1e01a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:59:31 user nova-compute[73029]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa (non-flash)
Aug 10 00:59:31 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 00:59:31 user nova-compute[73029]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa (non-flash)
Aug 10 00:59:31 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7528c71900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ca35ca-83d0-405d-8488-2a6a2a7cdee1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[351b82e1-7b80-4971-b8b2-6d2d372570a7]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fd41cc-6c69-41bb-beec-30cb3392fd29]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a6a47-4d0e-408f-922e-8ddfe20af149]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a225b841-ce27-4234-9096-295f9a825e53]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.network.neutron [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Updating instance_info_cache with network_info: [{"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabe098e-c2b0-4405-b189-de81cebe1942]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa, portal: 172.16.0.220,3260]
Aug 10 00:59:31 user nova-compute[73029]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa, portal: 172.16.0.220,3260] successful.
Aug 10 00:59:31 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66651093-ecd5-4669-8041-a80c119700aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[15838a0d-0e66-41bb-83f8-718514eafd14]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Releasing lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Instance network_info: |[{"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] <== disconnect_volume: return (342ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b4f777ac-2a0c-4ce0-9c15-42e6770a6eac req-055f8c52-ce63-4aff-93cd-03be25d0fc87 service nova] Acquired lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.network.neutron [req-b4f777ac-2a0c-4ce0-9c15-42e6770a6eac req-055f8c52-ce63-4aff-93cd-03be25d0fc87 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Refreshing network info cache for port c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Start _get_guest_xml network_info=[{"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 00:59:31 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:59:31 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-351865626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-351865626',id=35,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-fw0ym486',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:59:29Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=eb392795-1e14-4753-b0e3-0971ab34e369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:01:77,bridge_name='br-int',has_traffic_filtering=True,id=c4a926df-e2a2-438f-8953-535e20e82e86,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a926df-e2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.objects.instance [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'pci_devices' on Instance uuid eb392795-1e14-4753-b0e3-0971ab34e369 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] End _get_guest_xml xml=<domain type="kvm">
Aug 10 00:59:31 user nova-compute[73029]:   <uuid>eb392795-1e14-4753-b0e3-0971ab34e369</uuid>
Aug 10 00:59:31 user nova-compute[73029]:   <name>instance-00000023</name>
Aug 10 00:59:31 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 00:59:31 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 00:59:31 user nova-compute[73029]:   <metadata>
Aug 10 00:59:31 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 00:59:31 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 00:59:31 user nova-compute[73029]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-351865626</nova:name>
Aug 10 00:59:31 user nova-compute[73029]:       <nova:creationTime>2023-08-10 00:59:31</nova:creationTime>
Aug 10 00:59:31 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 00:59:31 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 00:59:31 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 00:59:31 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 00:59:31 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 00:59:31 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 00:59:31 user nova-compute[73029]:       </nova:flavor>
Aug 10 00:59:31 user nova-compute[73029]:       <nova:owner>
Aug 10 00:59:31 user nova-compute[73029]:         <nova:user uuid="6d34a91746034f349b7eeccfd372f21a">tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member</nova:user>
Aug 10 00:59:31 user nova-compute[73029]:         <nova:project uuid="39027fdade2f41048db7d3855f3197cc">tempest-ServerBootFromVolumeStableRescueTest-1463443327</nova:project>
Aug 10 00:59:31 user nova-compute[73029]:       </nova:owner>
Aug 10 00:59:31 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 00:59:31 user nova-compute[73029]:       <nova:ports>
Aug 10 00:59:31 user nova-compute[73029]:         <nova:port uuid="c4a926df-e2a2-438f-8953-535e20e82e86">
Aug 10 00:59:31 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 00:59:31 user nova-compute[73029]:         </nova:port>
Aug 10 00:59:31 user nova-compute[73029]:       </nova:ports>
Aug 10 00:59:31 user nova-compute[73029]:     </nova:instance>
Aug 10 00:59:31 user nova-compute[73029]:   </metadata>
Aug 10 00:59:31 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 00:59:31 user nova-compute[73029]:     <system>
Aug 10 00:59:31 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 00:59:31 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 00:59:31 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 00:59:31 user nova-compute[73029]:       <entry name="serial">eb392795-1e14-4753-b0e3-0971ab34e369</entry>
Aug 10 00:59:31 user nova-compute[73029]:       <entry name="uuid">eb392795-1e14-4753-b0e3-0971ab34e369</entry>
Aug 10 00:59:31 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 00:59:31 user nova-compute[73029]:     </system>
Aug 10 00:59:31 user nova-compute[73029]:   </sysinfo>
Aug 10 00:59:31 user nova-compute[73029]:   <os>
Aug 10 00:59:31 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 00:59:31 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 00:59:31 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 00:59:31 user nova-compute[73029]:   </os>
Aug 10 00:59:31 user nova-compute[73029]:   <features>
Aug 10 00:59:31 user nova-compute[73029]:     <acpi/>
Aug 10 00:59:31 user nova-compute[73029]:     <apic/>
Aug 10 00:59:31 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 00:59:31 user nova-compute[73029]:   </features>
Aug 10 00:59:31 user nova-compute[73029]:   <clock offset="utc">
Aug 10 00:59:31 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 00:59:31 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 00:59:31 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 00:59:31 user nova-compute[73029]:   </clock>
Aug 10 00:59:31 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 00:59:31 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 00:59:31 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 00:59:31 user nova-compute[73029]:   </cpu>
Aug 10 00:59:31 user nova-compute[73029]:   <devices>
Aug 10 00:59:31 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 00:59:31 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 00:59:31 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk"/>
Aug 10 00:59:31 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 00:59:31 user nova-compute[73029]:     </disk>
Aug 10 00:59:31 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 00:59:31 user nova-compute[73029]:       <mac address="fa:16:3e:58:01:77"/>
Aug 10 00:59:31 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:59:31 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 00:59:31 user nova-compute[73029]:       <target dev="tapc4a926df-e2"/>
Aug 10 00:59:31 user nova-compute[73029]:     </interface>
Aug 10 00:59:31 user nova-compute[73029]:     <serial type="pty">
Aug 10 00:59:31 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/console.log" append="off"/>
Aug 10 00:59:31 user nova-compute[73029]:     </serial>
Aug 10 00:59:31 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 00:59:31 user nova-compute[73029]:     <video>
Aug 10 00:59:31 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 00:59:31 user nova-compute[73029]:     </video>
Aug 10 00:59:31 user nova-compute[73029]:     <rng model="virtio">
Aug 10 00:59:31 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 00:59:31 user nova-compute[73029]:     </rng>
Aug 10 00:59:31 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 00:59:31 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 00:59:31 user nova-compute[73029]:       <stats period="10"/>
Aug 10 00:59:31 user nova-compute[73029]:     </memballoon>
Aug 10 00:59:31 user nova-compute[73029]:   </devices>
Aug 10 00:59:31 user nova-compute[73029]: </domain>
Aug 10 00:59:31 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-351865626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-351865626',id=35,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-fw0ym486',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T00:59:29Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=eb392795-1e14-4753-b0e3-0971ab34e369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:01:77,bridge_name='br-int',has_traffic_filtering=True,id=c4a926df-e2a2-438f-8953-535e20e82e86,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a926df-e2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG os_vif [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:01:77,bridge_name='br-int',has_traffic_filtering=True,id=c4a926df-e2a2-438f-8953-535e20e82e86,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a926df-e2') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4a926df-e2, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4a926df-e2, col_values=(('external_ids', {'iface-id': 'c4a926df-e2a2-438f-8953-535e20e82e86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:01:77', 'vm-uuid': 'eb392795-1e14-4753-b0e3-0971ab34e369'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:31 user nova-compute[73029]: INFO os_vif [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:01:77,bridge_name='br-int',has_traffic_filtering=True,id=c4a926df-e2a2-438f-8953-535e20e82e86,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a926df-e2')
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No VIF found with MAC fa:16:3e:58:01:77, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.network.neutron [req-b4f777ac-2a0c-4ce0-9c15-42e6770a6eac req-055f8c52-ce63-4aff-93cd-03be25d0fc87 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Updated VIF entry in instance network info cache for port c4a926df-e2a2-438f-8953-535e20e82e86. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG nova.network.neutron [req-b4f777ac-2a0c-4ce0-9c15-42e6770a6eac req-055f8c52-ce63-4aff-93cd-03be25d0fc87 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Updating instance_info_cache with network_info: [{"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:59:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b4f777ac-2a0c-4ce0-9c15-42e6770a6eac req-055f8c52-ce63-4aff-93cd-03be25d0fc87 service nova] Releasing lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'flavor' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8a677860-7f77-4438-b2da-1e5399fe6e6c tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-d2abada9-7ff7-4d77-b8c0-e4bfbd9b72c8 req-d48dba3e-2376-44e0-af14-8092ad54cdfa service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received event network-vif-plugged-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d2abada9-7ff7-4d77-b8c0-e4bfbd9b72c8 req-d48dba3e-2376-44e0-af14-8092ad54cdfa service nova] Acquiring lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d2abada9-7ff7-4d77-b8c0-e4bfbd9b72c8 req-d48dba3e-2376-44e0-af14-8092ad54cdfa service nova] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d2abada9-7ff7-4d77-b8c0-e4bfbd9b72c8 req-d48dba3e-2376-44e0-af14-8092ad54cdfa service nova] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-d2abada9-7ff7-4d77-b8c0-e4bfbd9b72c8 req-d48dba3e-2376-44e0-af14-8092ad54cdfa service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] No waiting events found dispatching network-vif-plugged-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:59:32 user nova-compute[73029]: WARNING nova.compute.manager [req-d2abada9-7ff7-4d77-b8c0-e4bfbd9b72c8 req-d48dba3e-2376-44e0-af14-8092ad54cdfa service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received unexpected event network-vif-plugged-c4a926df-e2a2-438f-8953-535e20e82e86 for instance with vm_state building and task_state spawning.
Aug 10 00:59:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updating instance_info_cache with network_info: [{"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-cd1ef428-2411-4cb8-bccd-7741e05e1a50" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629174.944806, eb392795-1e14-4753-b0e3-0971ab34e369 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:59:34 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] VM Resumed (Lifecycle Event)
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-8972497b-a7a7-4907-83a6-cbfeacf4bc66 req-3d6aee07-f391-486c-901f-9afd07bc21d8 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received event network-vif-plugged-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8972497b-a7a7-4907-83a6-cbfeacf4bc66 req-3d6aee07-f391-486c-901f-9afd07bc21d8 service nova] Acquiring lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8972497b-a7a7-4907-83a6-cbfeacf4bc66 req-3d6aee07-f391-486c-901f-9afd07bc21d8 service nova] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8972497b-a7a7-4907-83a6-cbfeacf4bc66 req-3d6aee07-f391-486c-901f-9afd07bc21d8 service nova] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.compute.manager [req-8972497b-a7a7-4907-83a6-cbfeacf4bc66 req-3d6aee07-f391-486c-901f-9afd07bc21d8 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] No waiting events found dispatching network-vif-plugged-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 00:59:34 user nova-compute[73029]: WARNING nova.compute.manager [req-8972497b-a7a7-4907-83a6-cbfeacf4bc66 req-3d6aee07-f391-486c-901f-9afd07bc21d8 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received unexpected event network-vif-plugged-c4a926df-e2a2-438f-8953-535e20e82e86 for instance with vm_state building and task_state spawning.
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 00:59:34 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Instance spawned successfully.
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 00:59:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:59:35 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629174.9451973, eb392795-1e14-4753-b0e3-0971ab34e369 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 00:59:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] VM Started (Lifecycle Event)
Aug 10 00:59:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:59:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 00:59:35 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 00:59:35 user nova-compute[73029]: INFO nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 10 00:59:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 00:59:35 user nova-compute[73029]: INFO nova.compute.manager [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Took 6.49 seconds to build instance.
Aug 10 00:59:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e78f815a-3afb-44e2-81cf-22aa6a95a9b1 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "eb392795-1e14-4753-b0e3-0971ab34e369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.612s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:39 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 00:59:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 00:59:41 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:59:41 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8221MB free_disk=25.13748550415039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 00:59:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 00:59:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 00:59:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 00:59:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:00:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:00:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:00:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:00:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:00:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:00:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:00:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:00:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:00:31 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:00:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:00:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:00:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:00:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:00:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:33 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:00:34 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:00:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updating instance_info_cache with network_info: [{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:00:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:00:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:00:42 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:00:43 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:00:43 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8240MB free_disk=25.09166717529297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance cd1ef428-2411-4cb8-bccd-7741e05e1a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:00:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:00:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:00:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:00:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:00:58 user nova-compute[73029]: INFO nova.compute.manager [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Terminating instance
Aug 10 01:00:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-e2c3ba21-b5ee-4c22-9e4a-0c6aaa28e871 req-bcd01ad8-f51d-4ca6-a94d-23d47e088266 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received event network-vif-unplugged-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e2c3ba21-b5ee-4c22-9e4a-0c6aaa28e871 req-bcd01ad8-f51d-4ca6-a94d-23d47e088266 service nova] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e2c3ba21-b5ee-4c22-9e4a-0c6aaa28e871 req-bcd01ad8-f51d-4ca6-a94d-23d47e088266 service nova] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e2c3ba21-b5ee-4c22-9e4a-0c6aaa28e871 req-bcd01ad8-f51d-4ca6-a94d-23d47e088266 service nova] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-e2c3ba21-b5ee-4c22-9e4a-0c6aaa28e871 req-bcd01ad8-f51d-4ca6-a94d-23d47e088266 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] No waiting events found dispatching network-vif-unplugged-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:00:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-e2c3ba21-b5ee-4c22-9e4a-0c6aaa28e871 req-bcd01ad8-f51d-4ca6-a94d-23d47e088266 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received event network-vif-unplugged-4ee4e715-c241-40fe-80d4-f848e01a8693 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:00:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Instance destroyed successfully.
Aug 10 01:00:59 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lazy-loading 'resources' on Instance uuid cd1ef428-2411-4cb8-bccd-7741e05e1a50 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1438349175',display_name='tempest-SnapshotDataIntegrityTests-server-1438349175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1438349175',id=31,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkNvOEsePUuh3FFHcoNYIYmLJWXjb4VsBU7H1I6DDfFjKhOopjkr6/DD2S3K/1R3m13xWpug18qdskbiwzLoumv3mBqEkKouMJ3EjdttXnXLz55iaf/wzaTygNyVBQczg==',key_name='tempest-keypair-1301247432',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:53:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e736dbfadf984fa28758873dea55945c',ramdisk_id='',reservation_id='r-23il1h9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-888070448',owner_user_name='tempest-SnapshotDataIntegrityTests-888070448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f7d59697076467684cf0116c8f4bb79',uuid=cd1ef428-2411-4cb8-bccd-7741e05e1a50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Converting VIF {"id": "4ee4e715-c241-40fe-80d4-f848e01a8693", "address": "fa:16:3e:fd:b9:fa", "network": {"id": "29959670-d800-429b-ab07-e231fc3821d4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-10833852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e736dbfadf984fa28758873dea55945c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee4e715-c2", "ovs_interfaceid": "4ee4e715-c241-40fe-80d4-f848e01a8693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=4ee4e715-c241-40fe-80d4-f848e01a8693,network=Network(29959670-d800-429b-ab07-e231fc3821d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee4e715-c2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG os_vif [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=4ee4e715-c241-40fe-80d4-f848e01a8693,network=Network(29959670-d800-429b-ab07-e231fc3821d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee4e715-c2') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ee4e715-c2, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:00:59 user nova-compute[73029]: INFO os_vif [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:b9:fa,bridge_name='br-int',has_traffic_filtering=True,id=4ee4e715-c241-40fe-80d4-f848e01a8693,network=Network(29959670-d800-429b-ab07-e231fc3821d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee4e715-c2')
Aug 10 01:00:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Deleting instance files /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50_del
Aug 10 01:00:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Deletion of /opt/stack/data/nova/instances/cd1ef428-2411-4cb8-bccd-7741e05e1a50_del complete
Aug 10 01:00:59 user nova-compute[73029]: INFO nova.compute.manager [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 10 01:00:59 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:00:59 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:01:00 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Took 1.40 seconds to deallocate network for instance.
Aug 10 01:01:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-3b88d882-38bf-410e-af38-e54e6ce3f119 req-6d0e8722-d6ac-4fa4-ab9e-5a494ca90e16 service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received event network-vif-deleted-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-d42a136d-af42-40bc-8a4e-4f62d9e3a1fe req-64aa6792-b7b1-4f3e-861d-2cda6035bc5b service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received event network-vif-plugged-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d42a136d-af42-40bc-8a4e-4f62d9e3a1fe req-64aa6792-b7b1-4f3e-861d-2cda6035bc5b service nova] Acquiring lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d42a136d-af42-40bc-8a4e-4f62d9e3a1fe req-64aa6792-b7b1-4f3e-861d-2cda6035bc5b service nova] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d42a136d-af42-40bc-8a4e-4f62d9e3a1fe req-64aa6792-b7b1-4f3e-861d-2cda6035bc5b service nova] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-d42a136d-af42-40bc-8a4e-4f62d9e3a1fe req-64aa6792-b7b1-4f3e-861d-2cda6035bc5b service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] No waiting events found dispatching network-vif-plugged-4ee4e715-c241-40fe-80d4-f848e01a8693 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:01:00 user nova-compute[73029]: WARNING nova.compute.manager [req-d42a136d-af42-40bc-8a4e-4f62d9e3a1fe req-64aa6792-b7b1-4f3e-861d-2cda6035bc5b service nova] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Received unexpected event network-vif-plugged-4ee4e715-c241-40fe-80d4-f848e01a8693 for instance with vm_state deleted and task_state None.
Aug 10 01:01:00 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:01:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:00 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Deleted allocations for instance cd1ef428-2411-4cb8-bccd-7741e05e1a50
Aug 10 01:01:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f5e093fd-c621-4f1d-990a-9c256e17bfd8 tempest-SnapshotDataIntegrityTests-888070448 tempest-SnapshotDataIntegrityTests-888070448-project-member] Lock "cd1ef428-2411-4cb8-bccd-7741e05e1a50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.751s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:01:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-98a72e3c-217e-4ed8-9564-f8eee7d8ad0b req-78044bde-c26f-4ead-988b-414d3c9eca07 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received event network-changed-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:01:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-98a72e3c-217e-4ed8-9564-f8eee7d8ad0b req-78044bde-c26f-4ead-988b-414d3c9eca07 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Refreshing instance network info cache due to event network-changed-8a355b8f-d4e5-4cd1-8e79-5f89027db341. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:01:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-98a72e3c-217e-4ed8-9564-f8eee7d8ad0b req-78044bde-c26f-4ead-988b-414d3c9eca07 service nova] Acquiring lock "refresh_cache-35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:01:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-98a72e3c-217e-4ed8-9564-f8eee7d8ad0b req-78044bde-c26f-4ead-988b-414d3c9eca07 service nova] Acquired lock "refresh_cache-35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:01:10 user nova-compute[73029]: DEBUG nova.network.neutron [req-98a72e3c-217e-4ed8-9564-f8eee7d8ad0b req-78044bde-c26f-4ead-988b-414d3c9eca07 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Refreshing network info cache for port 8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:01:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-98a72e3c-217e-4ed8-9564-f8eee7d8ad0b req-78044bde-c26f-4ead-988b-414d3c9eca07 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Updated VIF entry in instance network info cache for port 8a355b8f-d4e5-4cd1-8e79-5f89027db341. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:01:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-98a72e3c-217e-4ed8-9564-f8eee7d8ad0b req-78044bde-c26f-4ead-988b-414d3c9eca07 service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Updating instance_info_cache with network_info: [{"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:01:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-98a72e3c-217e-4ed8-9564-f8eee7d8ad0b req-78044bde-c26f-4ead-988b-414d3c9eca07 service nova] Releasing lock "refresh_cache-35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:01:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629259.0648184, cd1ef428-2411-4cb8-bccd-7741e05e1a50 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:01:14 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] VM Stopped (Lifecycle Event)
Aug 10 01:01:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-daac3a72-f0e9-4207-932c-2a49a2979e9b None None] [instance: cd1ef428-2411-4cb8-bccd-7741e05e1a50] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lazy-loading 'flavor' on Instance uuid 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:14 user nova-compute[73029]: INFO nova.compute.manager [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Attaching volume 4d4785a5-6387-4e94-a425-2d29fd637bcc to /dev/vdb
Aug 10 01:01:14 user nova-compute[73029]: DEBUG os_brick.utils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a94123-cbd1-4411-9e70-5d7974c6bb68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f204745-9619-4b0a-8cb6-7f6e6f45e6f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b0401c-659d-408e-8d37-43b12d2a89c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1b8586-0b6d-4cec-b6ad-69d5246f098a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:01:15 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:01:15 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6adfbc-81f3-4df2-bba9-d2885087f24b]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG os_brick.utils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:01:15 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Updating existing volume attachment record: 4193ede5-bf47-4b2e-a13e-7170dd8169b5 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:01:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:01:19 user nova-compute[73029]: INFO nova.compute.manager [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] instance snapshotting
Aug 10 01:01:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Beginning live snapshot process
Aug 10 01:01:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json -f qcow2 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json -f qcow2 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.187s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7evhmjml/dd38cc2d7558498fb98966d588be4b3a.delta 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7evhmjml/dd38cc2d7558498fb98966d588be4b3a.delta 1073741824" returned: 0 in 0.050s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:20 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 10 01:01:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 01:01:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 01:01:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 10 01:01:21 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 01:01:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7evhmjml/dd38cc2d7558498fb98966d588be4b3a.delta /opt/stack/data/nova/instances/snapshots/tmp7evhmjml/dd38cc2d7558498fb98966d588be4b3a {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:22 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7evhmjml/dd38cc2d7558498fb98966d588be4b3a.delta /opt/stack/data/nova/instances/snapshots/tmp7evhmjml/dd38cc2d7558498fb98966d588be4b3a" returned: 0 in 0.509s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Snapshot extracted, beginning image upload
Aug 10 01:01:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbGcmtid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:01:23 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:01:23 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:01:23 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d84bd1f-70eb-4589-ad15-4120fef9c5b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:01:23 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed2b0e4-57c0-47c7-97c1-f94c35d9fee9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc] added
Aug 10 01:01:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca240109-d993-4f5f-847c-67c091027e9e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b6f470-5acd-41c9-991f-84b186b6d9ef]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbGcmtid {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbGcmtid" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a94bdb4-d9e5-4ebf-bd70-1420c73ade73]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xbGcmtid'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[98595552-995a-47e4-b02d-332d6c920ae9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff5dadb-2c02-4916-a2ce-795f46b0094e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:01:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:01:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0a3644-1031-4c67-b3ed-014900aab722]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc, portal: 172.16.0.220,3260]
Aug 10 01:01:23 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc, portal: 172.16.0.220,3260] successful.
Aug 10 01:01:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f12aff-8716-40c1-8a4b-465a718026c1]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b21e30-3c97-4a69-acd9-90b0835bc322]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:01:23 user nova-compute[73029]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc (non-flash)
Aug 10 01:01:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:01:23 user nova-compute[73029]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc (non-flash)
Aug 10 01:01:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[17490dd3-d4fb-42f9-a8aa-86a336162f29]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:01:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbGcmtid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:01:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:01:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Snapshot image upload complete
Aug 10 01:01:24 user nova-compute[73029]: INFO nova.compute.manager [None req-4c749c91-dbd5-4a96-ba31-267a89276300 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Took 4.79 seconds to snapshot the instance on the hypervisor.
Aug 10 01:01:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:01:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23262303736666163', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:01:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262303736666163', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:01:24 user nova-compute[73029]: DEBUG nova.objects.instance [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lazy-loading 'flavor' on Instance uuid 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:01:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:01:24 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:01:24 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:01:24 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:01:24 user nova-compute[73029]:   <serial>4d4785a5-6387-4e94-a425-2d29fd637bcc</serial>
Aug 10 01:01:24 user nova-compute[73029]: </disk>
Aug 10 01:01:24 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:01:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:01:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:01:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] No VIF found with MAC fa:16:3e:c6:0c:c9, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:01:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-d5ab082e-c8af-4a01-bd91-4831ee4b1bf0 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.374s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:26 user nova-compute[73029]: INFO nova.compute.manager [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Detaching volume 4d4785a5-6387-4e94-a425-2d29fd637bcc
Aug 10 01:01:26 user nova-compute[73029]: INFO nova.virt.block_device [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Attempting to driver detach volume 4d4785a5-6387-4e94-a425-2d29fd637bcc from mountpoint /dev/vdb
Aug 10 01:01:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Attempting to detach device vdb from instance 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:01:26 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:01:26 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:01:26 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:01:26 user nova-compute[73029]:   <serial>4d4785a5-6387-4e94-a425-2d29fd637bcc</serial>
Aug 10 01:01:26 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:01:26 user nova-compute[73029]: </disk>
Aug 10 01:01:26 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:01:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Successfully detached device vdb from instance 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 from the persistent domain config.
Aug 10 01:01:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:01:26 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:01:26 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:01:26 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:01:26 user nova-compute[73029]:   <serial>4d4785a5-6387-4e94-a425-2d29fd637bcc</serial>
Aug 10 01:01:26 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:01:26 user nova-compute[73029]: </disk>
Aug 10 01:01:26 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691629286.9547226, 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:01:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Successfully detached device vdb from instance 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 from the live domain config.
Aug 10 01:01:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbGcmtid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:01:26 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:01:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcd7076-a1cc-4d81-a84f-343defd9eba6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[84211b52-c009-477f-9f46-4d70b88b5219]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:01:27 user nova-compute[73029]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc (non-flash)
Aug 10 01:01:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:01:27 user nova-compute[73029]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc (non-flash)
Aug 10 01:01:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7528c731c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b25a65-d02e-42e4-ac90-241ea80c020e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1174a19-775a-485b-ab37-3a986de223fb]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ddd49-b366-4ad3-99b7-33fdfe8f9bf6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f44278-b4a6-47b0-9a34-e0d747dee914]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[62981e40-c62a-4dae-9e82-c1386c36978b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[810536c7-ac26-4dab-a18c-84cb0126148a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc, portal: 172.16.0.220,3260]
Aug 10 01:01:27 user nova-compute[73029]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc, portal: 172.16.0.220,3260] successful.
Aug 10 01:01:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4785a5-6387-4e94-a425-2d29fd637bcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfaf805-3624-40b3-bffc-68d371abc755]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] <== disconnect_volume: return (255ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG nova.objects.instance [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lazy-loading 'flavor' on Instance uuid 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:01:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fc778941-321a-445b-8cf5-c70e77a57642 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.534s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:01:34 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:34 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:01:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:01:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:01:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:01:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:01:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:40 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:40 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:01:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:01:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:01:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:01:44 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:01:44 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:01:44 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8389MB free_disk=25.069290161132812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:01:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:01:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:51 user nova-compute[73029]: INFO nova.compute.manager [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Terminating instance
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-b5ec21fb-1137-4e8b-bb3b-04295cf32153 req-d13aafe6-b094-411a-9feb-4d294f938097 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received event network-vif-unplugged-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b5ec21fb-1137-4e8b-bb3b-04295cf32153 req-d13aafe6-b094-411a-9feb-4d294f938097 service nova] Acquiring lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b5ec21fb-1137-4e8b-bb3b-04295cf32153 req-d13aafe6-b094-411a-9feb-4d294f938097 service nova] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b5ec21fb-1137-4e8b-bb3b-04295cf32153 req-d13aafe6-b094-411a-9feb-4d294f938097 service nova] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-b5ec21fb-1137-4e8b-bb3b-04295cf32153 req-d13aafe6-b094-411a-9feb-4d294f938097 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] No waiting events found dispatching network-vif-unplugged-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-b5ec21fb-1137-4e8b-bb3b-04295cf32153 req-d13aafe6-b094-411a-9feb-4d294f938097 service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received event network-vif-unplugged-032db619-2c68-440b-8a21-5acd16a08c3f for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Instance destroyed successfully.
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.objects.instance [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lazy-loading 'resources' on Instance uuid a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1189812315',display_name='tempest-ServersNegativeTestJSON-server-1189812315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1189812315',id=30,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:53:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0830285a49344db872f7606cc837795',ramdisk_id='',reservation_id='r-8emnj17g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-533946204',owner_user_name='tempest-ServersNegativeTestJSON-533946204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:53:06Z,user_data=None,user_id='e4e4682fd39448e5b08386bec3de4b22',uuid=a3c67cb8-78f9-4664-8c86-cc429eb0b4f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converting VIF {"id": "032db619-2c68-440b-8a21-5acd16a08c3f", "address": "fa:16:3e:fa:45:88", "network": {"id": "a37d7139-c6af-4daf-bbc7-de4c8d60a1ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-530770614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0830285a49344db872f7606cc837795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032db619-2c", "ovs_interfaceid": "032db619-2c68-440b-8a21-5acd16a08c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:45:88,bridge_name='br-int',has_traffic_filtering=True,id=032db619-2c68-440b-8a21-5acd16a08c3f,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032db619-2c') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG os_vif [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:45:88,bridge_name='br-int',has_traffic_filtering=True,id=032db619-2c68-440b-8a21-5acd16a08c3f,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032db619-2c') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap032db619-2c, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:51 user nova-compute[73029]: INFO os_vif [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:45:88,bridge_name='br-int',has_traffic_filtering=True,id=032db619-2c68-440b-8a21-5acd16a08c3f,network=Network(a37d7139-c6af-4daf-bbc7-de4c8d60a1ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032db619-2c')
Aug 10 01:01:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Deleting instance files /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3_del
Aug 10 01:01:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Deletion of /opt/stack/data/nova/instances/a3c67cb8-78f9-4664-8c86-cc429eb0b4f3_del complete
Aug 10 01:01:51 user nova-compute[73029]: INFO nova.compute.manager [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 10 01:01:51 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:01:51 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:01:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:01:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:52 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:01:53 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Took 1.14 seconds to deallocate network for instance.
Aug 10 01:01:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-2053d763-3ef8-40c0-99ff-72ab85b3426a req-3b99920c-303e-402e-acb0-4c421dc2127f service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received event network-vif-deleted-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:01:53 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:01:53 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:01:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:53 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Deleted allocations for instance a3c67cb8-78f9-4664-8c86-cc429eb0b4f3
Aug 10 01:01:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-7937ceac-0ddf-4d9b-9de4-17c04aac95d2 req-17813f59-81e0-44f3-81c1-79b6dbef1ece service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received event network-vif-plugged-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:01:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7937ceac-0ddf-4d9b-9de4-17c04aac95d2 req-17813f59-81e0-44f3-81c1-79b6dbef1ece service nova] Acquiring lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:01:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7937ceac-0ddf-4d9b-9de4-17c04aac95d2 req-17813f59-81e0-44f3-81c1-79b6dbef1ece service nova] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:01:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7937ceac-0ddf-4d9b-9de4-17c04aac95d2 req-17813f59-81e0-44f3-81c1-79b6dbef1ece service nova] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-7937ceac-0ddf-4d9b-9de4-17c04aac95d2 req-17813f59-81e0-44f3-81c1-79b6dbef1ece service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] No waiting events found dispatching network-vif-plugged-032db619-2c68-440b-8a21-5acd16a08c3f {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:01:53 user nova-compute[73029]: WARNING nova.compute.manager [req-7937ceac-0ddf-4d9b-9de4-17c04aac95d2 req-17813f59-81e0-44f3-81c1-79b6dbef1ece service nova] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Received unexpected event network-vif-plugged-032db619-2c68-440b-8a21-5acd16a08c3f for instance with vm_state deleted and task_state None.
Aug 10 01:01:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-21d0bde2-9e38-4791-bb0f-ae741c724e04 tempest-ServersNegativeTestJSON-533946204 tempest-ServersNegativeTestJSON-533946204-project-member] Lock "a3c67cb8-78f9-4664-8c86-cc429eb0b4f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:01:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:01:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:02:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:02:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:02:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:02:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:06 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629311.77175, a3c67cb8-78f9-4664-8c86-cc429eb0b4f3 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:02:06 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] VM Stopped (Lifecycle Event)
Aug 10 01:02:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f50dcbc3-0fdd-4402-ab59-ff54bb8d7696 None None] [instance: a3c67cb8-78f9-4664-8c86-cc429eb0b4f3] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:02:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:02:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:22 user nova-compute[73029]: INFO nova.compute.manager [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Terminating instance
Aug 10 01:02:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4a5a5268-4102-4125-868f-9f9f2992e4c1 req-c2b7208c-1b10-440f-aa2f-46f74398514a service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received event network-vif-unplugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4a5a5268-4102-4125-868f-9f9f2992e4c1 req-c2b7208c-1b10-440f-aa2f-46f74398514a service nova] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4a5a5268-4102-4125-868f-9f9f2992e4c1 req-c2b7208c-1b10-440f-aa2f-46f74398514a service nova] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4a5a5268-4102-4125-868f-9f9f2992e4c1 req-c2b7208c-1b10-440f-aa2f-46f74398514a service nova] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4a5a5268-4102-4125-868f-9f9f2992e4c1 req-c2b7208c-1b10-440f-aa2f-46f74398514a service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] No waiting events found dispatching network-vif-unplugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-4a5a5268-4102-4125-868f-9f9f2992e4c1 req-c2b7208c-1b10-440f-aa2f-46f74398514a service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received event network-vif-unplugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:02:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:22 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Instance destroyed successfully.
Aug 10 01:02:22 user nova-compute[73029]: DEBUG nova.objects.instance [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lazy-loading 'resources' on Instance uuid 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173680949',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173680949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1173680',id=34,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7N2t45ttRtuO6MiF/zrwnL3qgFew5g7IBsPN0DcZQPHayA3IHBVh67pZmZgvFbl0VZG5Fdu2E7/7l6kHgdcEDMlr2xkHcUNzLgzefIXUbKM3jqjpt0Z0YIsRcQ/ajfog==',key_name='tempest-keypair-1847549140',keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:59:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='280502c983b740e4b70c15c433d3af93',ramdisk_id='',reservation_id='r-o4azcbi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-834894433',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e642789003f549d0ae27ed2d59e5d83f',uuid=35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Converting VIF {"id": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "address": "fa:16:3e:c6:0c:c9", "network": {"id": "17fa8dd9-bf32-450b-9992-f697628a45e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1779032394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280502c983b740e4b70c15c433d3af93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a355b8f-d4", "ovs_interfaceid": "8a355b8f-d4e5-4cd1-8e79-5f89027db341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=8a355b8f-d4e5-4cd1-8e79-5f89027db341,network=Network(17fa8dd9-bf32-450b-9992-f697628a45e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a355b8f-d4') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG os_vif [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=8a355b8f-d4e5-4cd1-8e79-5f89027db341,network=Network(17fa8dd9-bf32-450b-9992-f697628a45e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a355b8f-d4') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a355b8f-d4, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:02:23 user nova-compute[73029]: INFO os_vif [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=8a355b8f-d4e5-4cd1-8e79-5f89027db341,network=Network(17fa8dd9-bf32-450b-9992-f697628a45e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a355b8f-d4')
Aug 10 01:02:23 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Deleting instance files /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06_del
Aug 10 01:02:23 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Deletion of /opt/stack/data/nova/instances/35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06_del complete
Aug 10 01:02:23 user nova-compute[73029]: INFO nova.compute.manager [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 10 01:02:23 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:02:23 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Took 0.73 seconds to deallocate network for instance.
Aug 10 01:02:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:24 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:02:24 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:02:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:24 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Deleted allocations for instance 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06
Aug 10 01:02:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1e717539-dbb2-49e8-bd8b-b2690df95e03 tempest-TestServerVolumeAttachScenarioOldVersion-834894433 tempest-TestServerVolumeAttachScenarioOldVersion-834894433-project-member] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-29e1488b-6d1c-455b-9949-54b3466eed3a req-b97d288a-e898-4403-baf4-a034b5e55d9f service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received event network-vif-plugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:02:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-29e1488b-6d1c-455b-9949-54b3466eed3a req-b97d288a-e898-4403-baf4-a034b5e55d9f service nova] Acquiring lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-29e1488b-6d1c-455b-9949-54b3466eed3a req-b97d288a-e898-4403-baf4-a034b5e55d9f service nova] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-29e1488b-6d1c-455b-9949-54b3466eed3a req-b97d288a-e898-4403-baf4-a034b5e55d9f service nova] Lock "35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-29e1488b-6d1c-455b-9949-54b3466eed3a req-b97d288a-e898-4403-baf4-a034b5e55d9f service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] No waiting events found dispatching network-vif-plugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:02:24 user nova-compute[73029]: WARNING nova.compute.manager [req-29e1488b-6d1c-455b-9949-54b3466eed3a req-b97d288a-e898-4403-baf4-a034b5e55d9f service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received unexpected event network-vif-plugged-8a355b8f-d4e5-4cd1-8e79-5f89027db341 for instance with vm_state deleted and task_state None.
Aug 10 01:02:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-29e1488b-6d1c-455b-9949-54b3466eed3a req-b97d288a-e898-4403-baf4-a034b5e55d9f service nova] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Received event network-vif-deleted-8a355b8f-d4e5-4cd1-8e79-5f89027db341 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "93e11e7a-7de2-4783-a789-c2640267ce16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:02:26 user nova-compute[73029]: INFO nova.compute.claims [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Claim successful on node user
Aug 10 01:02:26 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:02:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:02:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:02:26 user nova-compute[73029]: DEBUG nova.policy [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d34a91746034f349b7eeccfd372f21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39027fdade2f41048db7d3855f3197cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:02:26 user nova-compute[73029]: INFO nova.virt.block_device [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Booting with volume-backed-image 48fbc2bc-b0d2-49bf-97dd-ed057d979427 at /dev/vda
Aug 10 01:02:27 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Successfully created port: 5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Successfully updated port: 5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquired lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-13d5ab37-f57b-40ea-a779-51019a8af2f9 req-50e10a57-0ecb-4924-839a-d7472a138dee service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-changed-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-13d5ab37-f57b-40ea-a779-51019a8af2f9 req-50e10a57-0ecb-4924-839a-d7472a138dee service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Refreshing instance network info cache due to event network-changed-5d0a86c1-b2a2-467c-a171-e02d5a5907fe. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-13d5ab37-f57b-40ea-a779-51019a8af2f9 req-50e10a57-0ecb-4924-839a-d7472a138dee service nova] Acquiring lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Updating instance_info_cache with network_info: [{"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Releasing lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Instance network_info: |[{"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-13d5ab37-f57b-40ea-a779-51019a8af2f9 req-50e10a57-0ecb-4924-839a-d7472a138dee service nova] Acquired lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:02:28 user nova-compute[73029]: DEBUG nova.network.neutron [req-13d5ab37-f57b-40ea-a779-51019a8af2f9 req-50e10a57-0ecb-4924-839a-d7472a138dee service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Refreshing network info cache for port 5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:02:29 user nova-compute[73029]: DEBUG nova.network.neutron [req-13d5ab37-f57b-40ea-a779-51019a8af2f9 req-50e10a57-0ecb-4924-839a-d7472a138dee service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Updated VIF entry in instance network info cache for port 5d0a86c1-b2a2-467c-a171-e02d5a5907fe. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:02:29 user nova-compute[73029]: DEBUG nova.network.neutron [req-13d5ab37-f57b-40ea-a779-51019a8af2f9 req-50e10a57-0ecb-4924-839a-d7472a138dee service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Updating instance_info_cache with network_info: [{"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:02:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-13d5ab37-f57b-40ea-a779-51019a8af2f9 req-50e10a57-0ecb-4924-839a-d7472a138dee service nova] Releasing lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:02:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:02:33 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:34 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Skipping network cache update for instance because it is Building. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 1c23f226-a16a-4158-bac9-b9d78381fb5c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updating instance_info_cache with network_info: [{"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:36 user nova-compute[73029]: WARNING nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 1c23f226-a16a-4158-bac9-b9d78381fb5c {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid eb392795-1e14-4753-b0e3-0971ab34e369 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "eb392795-1e14-4753-b0e3-0971ab34e369" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "eb392795-1e14-4753-b0e3-0971ab34e369" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "eb392795-1e14-4753-b0e3-0971ab34e369" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG os_brick.utils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c15b12d-e003-4883-b166-d9cd4d6ff460]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a928567-08e1-494b-a0b2-9b935c5b9ff9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd80f22-e835-4cbc-9367-728bae59c3d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[234cd99b-ad71-4c0c-87cd-b1431a046fb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:02:37 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:02:37 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b216121-12d5-40ad-8352-50222a1d5c49]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG os_brick.utils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Updating existing volume attachment record: 3d132c7f-305e-4162-854b-b05796ec849a {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:02:37 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629342.9873538, 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:02:37 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] VM Stopped (Lifecycle Event)
Aug 10 01:02:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0af3c69a-9cf8-4d4f-a216-9207d2639658 None None] [instance: 35586dc0-6d83-4dfa-8cc3-bf9c3e8cbf06] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:02:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:02:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:02:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:41 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:45 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:02:45 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=25.115001678466797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 93e11e7a-7de2-4783-a789-c2640267ce16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:02:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:02:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Creating image(s)
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Ensure instance console log exists: /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Start _get_guest_xml network_info=[{"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '3d132c7f-305e-4162-854b-b05796ec849a', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcnMdoOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '93e11e7a-7de2-4783-a789-c2640267ce16', 'attached_at': '', 'detached_at': '', 'volume_id': '87c99c64-be34-4606-a27d-4ba5300ef961', 'serial': '87c99c64-be34-4606-a27d-4ba5300ef961'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:02:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:02:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcnMdoOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:02:46 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:02:46 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:02:46 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ee6453-f06b-4e3b-9b31-cfbc1ca77235]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:02:46 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb4a9ca-10ff-4f3c-afe2-ced627e3ccf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961] added
Aug 10 01:02:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0da01d-92a3-4af9-a9c0-3998421b1621]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3172632a-a492-424d-bc57-6cc776d20e87]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kcnMdoOy {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kcnMdoOy" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d54044-f69a-4cc3-9f72-4c462e939ade]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kcnMdoOy'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0058e898-37da-4d1f-88b3-f15ca27e95a2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cb5860-39b5-4ef8-ac92-76b2946c7965]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:02:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:02:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a284ec66-15c7-4e2d-b4eb-8cba39466bcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961, portal: 172.16.0.220,3260]
Aug 10 01:02:46 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961, portal: 172.16.0.220,3260] successful.
Aug 10 01:02:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b09dac-4e90-42ca-964a-f82aac2f1fd3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86684fa-32bb-4fc2-9282-3a4296eef688]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:02:46 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:02:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:02:46 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:02:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b0803-28e1-488e-9476-458be71219ae]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:02:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcnMdoOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23063633762343639', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063633762343639', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-889332447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-889332447',id=36,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-z2gzgybl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:02:27Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=93e11e7a-7de2-4783-a789-c2640267ce16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:c8:6c,bridge_name='br-int',has_traffic_filtering=True,id=5d0a86c1-b2a2-467c-a171-e02d5a5907fe,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0a86c1-b2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'pci_devices' on Instance uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:02:47 user nova-compute[73029]:   <uuid>93e11e7a-7de2-4783-a789-c2640267ce16</uuid>
Aug 10 01:02:47 user nova-compute[73029]:   <name>instance-00000024</name>
Aug 10 01:02:47 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:02:47 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:02:47 user nova-compute[73029]:   <metadata>
Aug 10 01:02:47 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:02:47 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:02:47 user nova-compute[73029]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-889332447</nova:name>
Aug 10 01:02:47 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:02:46</nova:creationTime>
Aug 10 01:02:47 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:02:47 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:02:47 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:02:47 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:02:47 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:02:47 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:02:47 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:02:47 user nova-compute[73029]:       <nova:owner>
Aug 10 01:02:47 user nova-compute[73029]:         <nova:user uuid="6d34a91746034f349b7eeccfd372f21a">tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member</nova:user>
Aug 10 01:02:47 user nova-compute[73029]:         <nova:project uuid="39027fdade2f41048db7d3855f3197cc">tempest-ServerBootFromVolumeStableRescueTest-1463443327</nova:project>
Aug 10 01:02:47 user nova-compute[73029]:       </nova:owner>
Aug 10 01:02:47 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:02:47 user nova-compute[73029]:       <nova:ports>
Aug 10 01:02:47 user nova-compute[73029]:         <nova:port uuid="5d0a86c1-b2a2-467c-a171-e02d5a5907fe">
Aug 10 01:02:47 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 01:02:47 user nova-compute[73029]:         </nova:port>
Aug 10 01:02:47 user nova-compute[73029]:       </nova:ports>
Aug 10 01:02:47 user nova-compute[73029]:     </nova:instance>
Aug 10 01:02:47 user nova-compute[73029]:   </metadata>
Aug 10 01:02:47 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:02:47 user nova-compute[73029]:     <system>
Aug 10 01:02:47 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:02:47 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:02:47 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:02:47 user nova-compute[73029]:       <entry name="serial">93e11e7a-7de2-4783-a789-c2640267ce16</entry>
Aug 10 01:02:47 user nova-compute[73029]:       <entry name="uuid">93e11e7a-7de2-4783-a789-c2640267ce16</entry>
Aug 10 01:02:47 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:02:47 user nova-compute[73029]:     </system>
Aug 10 01:02:47 user nova-compute[73029]:   </sysinfo>
Aug 10 01:02:47 user nova-compute[73029]:   <os>
Aug 10 01:02:47 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:02:47 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:02:47 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:02:47 user nova-compute[73029]:   </os>
Aug 10 01:02:47 user nova-compute[73029]:   <features>
Aug 10 01:02:47 user nova-compute[73029]:     <acpi/>
Aug 10 01:02:47 user nova-compute[73029]:     <apic/>
Aug 10 01:02:47 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:02:47 user nova-compute[73029]:   </features>
Aug 10 01:02:47 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:02:47 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:02:47 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:02:47 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:02:47 user nova-compute[73029]:   </clock>
Aug 10 01:02:47 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:02:47 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:02:47 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:02:47 user nova-compute[73029]:   </cpu>
Aug 10 01:02:47 user nova-compute[73029]:   <devices>
Aug 10 01:02:47 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:02:47 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:02:47 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 01:02:47 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:02:47 user nova-compute[73029]:       <serial>87c99c64-be34-4606-a27d-4ba5300ef961</serial>
Aug 10 01:02:47 user nova-compute[73029]:     </disk>
Aug 10 01:02:47 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:02:47 user nova-compute[73029]:       <mac address="fa:16:3e:1c:c8:6c"/>
Aug 10 01:02:47 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:02:47 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:02:47 user nova-compute[73029]:       <target dev="tap5d0a86c1-b2"/>
Aug 10 01:02:47 user nova-compute[73029]:     </interface>
Aug 10 01:02:47 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:02:47 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/console.log" append="off"/>
Aug 10 01:02:47 user nova-compute[73029]:     </serial>
Aug 10 01:02:47 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:02:47 user nova-compute[73029]:     <video>
Aug 10 01:02:47 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:02:47 user nova-compute[73029]:     </video>
Aug 10 01:02:47 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:02:47 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:02:47 user nova-compute[73029]:     </rng>
Aug 10 01:02:47 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:02:47 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:02:47 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:02:47 user nova-compute[73029]:     </memballoon>
Aug 10 01:02:47 user nova-compute[73029]:   </devices>
Aug 10 01:02:47 user nova-compute[73029]: </domain>
Aug 10 01:02:47 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-889332447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-889332447',id=36,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-z2gzgybl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:02:27Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=93e11e7a-7de2-4783-a789-c2640267ce16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:c8:6c,bridge_name='br-int',has_traffic_filtering=True,id=5d0a86c1-b2a2-467c-a171-e02d5a5907fe,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0a86c1-b2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG os_vif [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:c8:6c,bridge_name='br-int',has_traffic_filtering=True,id=5d0a86c1-b2a2-467c-a171-e02d5a5907fe,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0a86c1-b2') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d0a86c1-b2, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d0a86c1-b2, col_values=(('external_ids', {'iface-id': '5d0a86c1-b2a2-467c-a171-e02d5a5907fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:c8:6c', 'vm-uuid': '93e11e7a-7de2-4783-a789-c2640267ce16'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:47 user nova-compute[73029]: INFO os_vif [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:c8:6c,bridge_name='br-int',has_traffic_filtering=True,id=5d0a86c1-b2a2-467c-a171-e02d5a5907fe,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0a86c1-b2')
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:02:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No VIF found with MAC fa:16:3e:1c:c8:6c, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:02:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-f92f8f19-57a1-49e2-992c-c05a8e4b6b6f req-3f9073ee-679b-440c-90f8-a07ec49df038 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:02:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f92f8f19-57a1-49e2-992c-c05a8e4b6b6f req-3f9073ee-679b-440c-90f8-a07ec49df038 service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f92f8f19-57a1-49e2-992c-c05a8e4b6b6f req-3f9073ee-679b-440c-90f8-a07ec49df038 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f92f8f19-57a1-49e2-992c-c05a8e4b6b6f req-3f9073ee-679b-440c-90f8-a07ec49df038 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-f92f8f19-57a1-49e2-992c-c05a8e4b6b6f req-3f9073ee-679b-440c-90f8-a07ec49df038 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:02:49 user nova-compute[73029]: WARNING nova.compute.manager [req-f92f8f19-57a1-49e2-992c-c05a8e4b6b6f req-3f9073ee-679b-440c-90f8-a07ec49df038 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state building and task_state spawning.
Aug 10 01:02:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629371.3874285, 93e11e7a-7de2-4783-a789-c2640267ce16 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:02:51 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] VM Resumed (Lifecycle Event)
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:02:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Instance spawned successfully.
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:02:51 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629371.3884451, 93e11e7a-7de2-4783-a789-c2640267ce16 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:02:51 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] VM Started (Lifecycle Event)
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-da1a5932-1029-425c-9c77-834aa4e01c2f req-0a8d5d5a-e49a-46b3-85fc-048dbcbabfd5 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-da1a5932-1029-425c-9c77-834aa4e01c2f req-0a8d5d5a-e49a-46b3-85fc-048dbcbabfd5 service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-da1a5932-1029-425c-9c77-834aa4e01c2f req-0a8d5d5a-e49a-46b3-85fc-048dbcbabfd5 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-da1a5932-1029-425c-9c77-834aa4e01c2f req-0a8d5d5a-e49a-46b3-85fc-048dbcbabfd5 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-da1a5932-1029-425c-9c77-834aa4e01c2f req-0a8d5d5a-e49a-46b3-85fc-048dbcbabfd5 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:02:51 user nova-compute[73029]: WARNING nova.compute.manager [req-da1a5932-1029-425c-9c77-834aa4e01c2f req-0a8d5d5a-e49a-46b3-85fc-048dbcbabfd5 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state building and task_state spawning.
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:02:51 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:02:51 user nova-compute[73029]: INFO nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Took 5.03 seconds to spawn the instance on the hypervisor.
Aug 10 01:02:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:02:51 user nova-compute[73029]: INFO nova.compute.manager [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Took 25.13 seconds to build instance.
Aug 10 01:02:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0b65e412-2169-4655-92c2-8c4a15155ead tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "93e11e7a-7de2-4783-a789-c2640267ce16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.225s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "93e11e7a-7de2-4783-a789-c2640267ce16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.074s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:51 user nova-compute[73029]: INFO nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 10 01:02:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "93e11e7a-7de2-4783-a789-c2640267ce16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:02:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:02:56 user nova-compute[73029]: INFO nova.compute.claims [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Claim successful on node user
Aug 10 01:02:56 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:02:56 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:02:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.policy [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45605bba94154ec797f1be53cd778876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed8b4d1eded488da4e1dc7c699bf32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:02:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Creating image(s)
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk 1073741824" returned: 0 in 0.051s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Checking if we can resize image /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Successfully created port: 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Cannot resize image /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.objects.instance [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'migration_context' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Ensure instance console log exists: /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.network.neutron [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Successfully updated port: 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquired lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.network.neutron [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-57d48188-4ac2-4a9e-bf14-7c96193951d1 req-2354d4e8-d615-41bc-9098-a7d556136901 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-changed-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-57d48188-4ac2-4a9e-bf14-7c96193951d1 req-2354d4e8-d615-41bc-9098-a7d556136901 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Refreshing instance network info cache due to event network-changed-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-57d48188-4ac2-4a9e-bf14-7c96193951d1 req-2354d4e8-d615-41bc-9098-a7d556136901 service nova] Acquiring lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.network.neutron [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.network.neutron [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating instance_info_cache with network_info: [{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Releasing lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance network_info: |[{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-57d48188-4ac2-4a9e-bf14-7c96193951d1 req-2354d4e8-d615-41bc-9098-a7d556136901 service nova] Acquired lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.network.neutron [req-57d48188-4ac2-4a9e-bf14-7c96193951d1 req-2354d4e8-d615-41bc-9098-a7d556136901 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Refreshing network info cache for port 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Start _get_guest_xml network_info=[{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:02:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:02:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1833026875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1833026875',id=37,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEGdNiwx5QbPl7vlPccwSGe70dJI33VDMaLMH86viCzaIqe6Ww1es4Ta9D5hunhHT8FNMAbuCzsJpwkfMgC93tfQOL7K/UqLwCidUygGmNMdkDso7AY0IPTVmNeEvSzLw==',key_name='tempest-keypair-1337121988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-50czkq8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=453a13a0-f725-4bc0-9ff2-c8dee38cad41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.objects.instance [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'pci_devices' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:02:58 user nova-compute[73029]:   <uuid>453a13a0-f725-4bc0-9ff2-c8dee38cad41</uuid>
Aug 10 01:02:58 user nova-compute[73029]:   <name>instance-00000025</name>
Aug 10 01:02:58 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:02:58 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:02:58 user nova-compute[73029]:   <metadata>
Aug 10 01:02:58 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:02:58 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:02:58 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1833026875</nova:name>
Aug 10 01:02:58 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:02:58</nova:creationTime>
Aug 10 01:02:58 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:02:58 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:02:58 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:02:58 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:02:58 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:02:58 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:02:58 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:02:58 user nova-compute[73029]:       <nova:owner>
Aug 10 01:02:58 user nova-compute[73029]:         <nova:user uuid="45605bba94154ec797f1be53cd778876">tempest-AttachVolumeShelveTestJSON-2077435926-project-member</nova:user>
Aug 10 01:02:58 user nova-compute[73029]:         <nova:project uuid="6ed8b4d1eded488da4e1dc7c699bf32b">tempest-AttachVolumeShelveTestJSON-2077435926</nova:project>
Aug 10 01:02:58 user nova-compute[73029]:       </nova:owner>
Aug 10 01:02:58 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:02:58 user nova-compute[73029]:       <nova:ports>
Aug 10 01:02:58 user nova-compute[73029]:         <nova:port uuid="1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf">
Aug 10 01:02:58 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 10 01:02:58 user nova-compute[73029]:         </nova:port>
Aug 10 01:02:58 user nova-compute[73029]:       </nova:ports>
Aug 10 01:02:58 user nova-compute[73029]:     </nova:instance>
Aug 10 01:02:58 user nova-compute[73029]:   </metadata>
Aug 10 01:02:58 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:02:58 user nova-compute[73029]:     <system>
Aug 10 01:02:58 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:02:58 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:02:58 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:02:58 user nova-compute[73029]:       <entry name="serial">453a13a0-f725-4bc0-9ff2-c8dee38cad41</entry>
Aug 10 01:02:58 user nova-compute[73029]:       <entry name="uuid">453a13a0-f725-4bc0-9ff2-c8dee38cad41</entry>
Aug 10 01:02:58 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:02:58 user nova-compute[73029]:     </system>
Aug 10 01:02:58 user nova-compute[73029]:   </sysinfo>
Aug 10 01:02:58 user nova-compute[73029]:   <os>
Aug 10 01:02:58 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:02:58 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:02:58 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:02:58 user nova-compute[73029]:   </os>
Aug 10 01:02:58 user nova-compute[73029]:   <features>
Aug 10 01:02:58 user nova-compute[73029]:     <acpi/>
Aug 10 01:02:58 user nova-compute[73029]:     <apic/>
Aug 10 01:02:58 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:02:58 user nova-compute[73029]:   </features>
Aug 10 01:02:58 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:02:58 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:02:58 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:02:58 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:02:58 user nova-compute[73029]:   </clock>
Aug 10 01:02:58 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:02:58 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:02:58 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:02:58 user nova-compute[73029]:   </cpu>
Aug 10 01:02:58 user nova-compute[73029]:   <devices>
Aug 10 01:02:58 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:02:58 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:02:58 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk"/>
Aug 10 01:02:58 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:02:58 user nova-compute[73029]:     </disk>
Aug 10 01:02:58 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:02:58 user nova-compute[73029]:       <mac address="fa:16:3e:29:44:d2"/>
Aug 10 01:02:58 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:02:58 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:02:58 user nova-compute[73029]:       <target dev="tap1f6bfbc9-b8"/>
Aug 10 01:02:58 user nova-compute[73029]:     </interface>
Aug 10 01:02:58 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:02:58 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/console.log" append="off"/>
Aug 10 01:02:58 user nova-compute[73029]:     </serial>
Aug 10 01:02:58 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:02:58 user nova-compute[73029]:     <video>
Aug 10 01:02:58 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:02:58 user nova-compute[73029]:     </video>
Aug 10 01:02:58 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:02:58 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:02:58 user nova-compute[73029]:     </rng>
Aug 10 01:02:58 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:02:58 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:02:58 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:02:58 user nova-compute[73029]:     </memballoon>
Aug 10 01:02:58 user nova-compute[73029]:   </devices>
Aug 10 01:02:58 user nova-compute[73029]: </domain>
Aug 10 01:02:58 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1833026875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1833026875',id=37,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEGdNiwx5QbPl7vlPccwSGe70dJI33VDMaLMH86viCzaIqe6Ww1es4Ta9D5hunhHT8FNMAbuCzsJpwkfMgC93tfQOL7K/UqLwCidUygGmNMdkDso7AY0IPTVmNeEvSzLw==',key_name='tempest-keypair-1337121988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-50czkq8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=453a13a0-f725-4bc0-9ff2-c8dee38cad41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG os_vif [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f6bfbc9-b8, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f6bfbc9-b8, col_values=(('external_ids', {'iface-id': '1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:44:d2', 'vm-uuid': '453a13a0-f725-4bc0-9ff2-c8dee38cad41'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:02:58 user nova-compute[73029]: INFO os_vif [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8')
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:02:58 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] No VIF found with MAC fa:16:3e:29:44:d2, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:02:59 user nova-compute[73029]: DEBUG nova.network.neutron [req-57d48188-4ac2-4a9e-bf14-7c96193951d1 req-2354d4e8-d615-41bc-9098-a7d556136901 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updated VIF entry in instance network info cache for port 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:02:59 user nova-compute[73029]: DEBUG nova.network.neutron [req-57d48188-4ac2-4a9e-bf14-7c96193951d1 req-2354d4e8-d615-41bc-9098-a7d556136901 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating instance_info_cache with network_info: [{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:02:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-57d48188-4ac2-4a9e-bf14-7c96193951d1 req-2354d4e8-d615-41bc-9098-a7d556136901 service nova] Releasing lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-57d2caa1-6386-4241-b9cb-8384659a0b8b req-e1312ce0-bb10-4431-83b0-a8f2f709edd8 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-57d2caa1-6386-4241-b9cb-8384659a0b8b req-e1312ce0-bb10-4431-83b0-a8f2f709edd8 service nova] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-57d2caa1-6386-4241-b9cb-8384659a0b8b req-e1312ce0-bb10-4431-83b0-a8f2f709edd8 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-57d2caa1-6386-4241-b9cb-8384659a0b8b req-e1312ce0-bb10-4431-83b0-a8f2f709edd8 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-57d2caa1-6386-4241-b9cb-8384659a0b8b req-e1312ce0-bb10-4431-83b0-a8f2f709edd8 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] No waiting events found dispatching network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:03:00 user nova-compute[73029]: WARNING nova.compute.manager [req-57d2caa1-6386-4241-b9cb-8384659a0b8b req-e1312ce0-bb10-4431-83b0-a8f2f709edd8 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received unexpected event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf for instance with vm_state building and task_state spawning.
Aug 10 01:03:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629382.3787134, 453a13a0-f725-4bc0-9ff2-c8dee38cad41 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:03:02 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] VM Resumed (Lifecycle Event)
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:03:02 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance spawned successfully.
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:03:02 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629382.3845544, 453a13a0-f725-4bc0-9ff2-c8dee38cad41 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:03:02 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] VM Started (Lifecycle Event)
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:03:02 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:03:02 user nova-compute[73029]: INFO nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Took 5.28 seconds to spawn the instance on the hypervisor.
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:03:02 user nova-compute[73029]: INFO nova.compute.manager [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Took 5.86 seconds to build instance.
Aug 10 01:03:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1c0fe25c-245f-452b-abfa-6f6a6e06dfc1 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.950s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.compute.manager [req-2433ac83-3eda-4dc3-a001-c37389135b00 req-b2d9f8f4-a310-4bc8-8e20-e4906bc35627 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2433ac83-3eda-4dc3-a001-c37389135b00 req-b2d9f8f4-a310-4bc8-8e20-e4906bc35627 service nova] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2433ac83-3eda-4dc3-a001-c37389135b00 req-b2d9f8f4-a310-4bc8-8e20-e4906bc35627 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2433ac83-3eda-4dc3-a001-c37389135b00 req-b2d9f8f4-a310-4bc8-8e20-e4906bc35627 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:03:02 user nova-compute[73029]: DEBUG nova.compute.manager [req-2433ac83-3eda-4dc3-a001-c37389135b00 req-b2d9f8f4-a310-4bc8-8e20-e4906bc35627 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] No waiting events found dispatching network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:03:02 user nova-compute[73029]: WARNING nova.compute.manager [req-2433ac83-3eda-4dc3-a001-c37389135b00 req-b2d9f8f4-a310-4bc8-8e20-e4906bc35627 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received unexpected event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf for instance with vm_state active and task_state None.
Aug 10 01:03:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:03:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:03:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:03:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:03:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updating instance_info_cache with network_info: [{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:03:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:03:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:03:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:03:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:03:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:03:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:03:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:40 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:03:41 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:43 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:03:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:03:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:03:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8392MB free_disk=25.07501983642578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 93e11e7a-7de2-4783-a789-c2640267ce16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:03:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:03:48 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:03:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:03:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:03:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:03:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:03:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:03:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:03:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:04:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:04:17 user nova-compute[73029]: INFO nova.compute.manager [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Rescuing
Aug 10 01:04:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:04:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquired lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:04:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:04:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Updating instance_info_cache with network_info: [{"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:04:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Releasing lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:04:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-22172a88-f642-4814-bfba-e050015ecd5a req-c2a1d5e9-96e1-4bcf-95a5-a5e2e1c4cb32 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-unplugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-22172a88-f642-4814-bfba-e050015ecd5a req-c2a1d5e9-96e1-4bcf-95a5-a5e2e1c4cb32 service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-22172a88-f642-4814-bfba-e050015ecd5a req-c2a1d5e9-96e1-4bcf-95a5-a5e2e1c4cb32 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-22172a88-f642-4814-bfba-e050015ecd5a req-c2a1d5e9-96e1-4bcf-95a5-a5e2e1c4cb32 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-22172a88-f642-4814-bfba-e050015ecd5a req-c2a1d5e9-96e1-4bcf-95a5-a5e2e1c4cb32 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-unplugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:04:18 user nova-compute[73029]: WARNING nova.compute.manager [req-22172a88-f642-4814-bfba-e050015ecd5a req-c2a1d5e9-96e1-4bcf-95a5-a5e2e1c4cb32 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-unplugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state active and task_state rescuing.
Aug 10 01:04:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Instance destroyed successfully.
Aug 10 01:04:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Attempting a stable device rescue
Aug 10 01:04:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73029) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Instance directory exists: not creating {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 10 01:04:18 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Creating image(s)
Aug 10 01:04:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "/opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "/opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "/opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'trusted_certs' on Instance uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "d8e36725346359ef91f20fc825283ffd1aa20308" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "d8e36725346359ef91f20fc825283ffd1aa20308" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308.part --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:19 user nova-compute[73029]: DEBUG nova.virt.images [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] 1ba71beb-0871-4e96-861e-6c890bd8c966 was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 01:04:19 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 01:04:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308.part /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-8ed4fbfb-0308-4748-8c03-49cca054a06a req-31564661-4453-4b7e-9e70-a11f19b943a2 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8ed4fbfb-0308-4748-8c03-49cca054a06a req-31564661-4453-4b7e-9e70-a11f19b943a2 service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8ed4fbfb-0308-4748-8c03-49cca054a06a req-31564661-4453-4b7e-9e70-a11f19b943a2 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8ed4fbfb-0308-4748-8c03-49cca054a06a req-31564661-4453-4b7e-9e70-a11f19b943a2 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-8ed4fbfb-0308-4748-8c03-49cca054a06a req-31564661-4453-4b7e-9e70-a11f19b943a2 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:04:20 user nova-compute[73029]: WARNING nova.compute.manager [req-8ed4fbfb-0308-4748-8c03-49cca054a06a req-31564661-4453-4b7e-9e70-a11f19b943a2 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state active and task_state rescuing.
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308.part /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308.converted" returned: 0 in 0.690s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "d8e36725346359ef91f20fc825283ffd1aa20308" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.156s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "d8e36725346359ef91f20fc825283ffd1aa20308" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "d8e36725346359ef91f20fc825283ffd1aa20308" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308 --force-share --output=json" returned: 0 in 0.158s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308,backing_fmt=raw /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308,backing_fmt=raw /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue" returned: 0 in 0.063s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "d8e36725346359ef91f20fc825283ffd1aa20308" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'migration_context' on Instance uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Start _get_guest_xml network_info=[{"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "vif_mac": "fa:16:3e:1c:c8:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1ba71beb-0871-4e96-861e-6c890bd8c966', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '3d132c7f-305e-4162-854b-b05796ec849a', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcnMdoOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '93e11e7a-7de2-4783-a789-c2640267ce16', 'attached_at': '', 'detached_at': '', 'volume_id': '87c99c64-be34-4606-a27d-4ba5300ef961', 'serial': '87c99c64-be34-4606-a27d-4ba5300ef961'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'resources' on Instance uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:04:20 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'numa_topology' on Instance uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:04:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:04:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcnMdoOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:04:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:04:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:04:21 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[878b2213-ed83-4320-96f8-5250f3776587]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kcnMdoOy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 10 01:04:21 user nova-compute[73029]: node.name = iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961
Aug 10 01:04:21 user nova-compute[73029]: node.tpgt = -1
Aug 10 01:04:21 user nova-compute[73029]: node.startup = automatic
Aug 10 01:04:21 user nova-compute[73029]: node.leading_login = No
Aug 10 01:04:21 user nova-compute[73029]: iface.iscsi_ifacename = default
Aug 10 01:04:21 user nova-compute[73029]: iface.net_ifacename = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.ipaddress = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.prefix_len = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.hwaddress = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.transport_name = tcp
Aug 10 01:04:21 user nova-compute[73029]: iface.initiatorname = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.state = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.vlan_id = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.vlan_priority = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.vlan_state = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.iface_num = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.mtu = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.port = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.bootproto = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.subnet_mask = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.gateway = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.dhcp_alt_client_id_state = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.dhcp_alt_client_id = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.dhcp_dns = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.dhcp_learn_iqn = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.dhcp_req_vendor_id_state = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.dhcp_vendor_id_state = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.dhcp_vendor_id = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.dhcp_slp_da = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.fragmentation = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.gratuitous_arp = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.incoming_forwarding = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.tos_state = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.tos = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.ttl = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.delayed_ack = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.tcp_nagle = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.tcp_wsf_state = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.tcp_wsf = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.tcp_timer_scale = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.tcp_timestamp = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.redirect = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.def_task_mgmt_timeout = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.header_digest = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.data_digest = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.immediate_data = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.initial_r2t = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.data_seq_inorder = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.data_pdu_inorder = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.erl = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.max_receive_data_len = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.first_burst_len = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.max_outstanding_r2t = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.max_burst_len = 0
Aug 10 01:04:21 user nova-compute[73029]: iface.chap_auth = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.bidi_chap = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.strict_login_compliance = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.discovery_auth = <empty>
Aug 10 01:04:21 user nova-compute[73029]: iface.discovery_logout = <empty>
Aug 10 01:04:21 user nova-compute[73029]: node.discovery_address = <empty>
Aug 10 01:04:21 user nova-compute[73029]: node.discovery_port = 0
Aug 10 01:04:21 user nova-compute[73029]: node.discovery_type = static
Aug 10 01:04:21 user nova-compute[73029]: node.session.initial_cmdsn = 0
Aug 10 01:04:21 user nova-compute[73029]: node.session.initial_login_retry_max = 8
Aug 10 01:04:21 user nova-compute[73029]: node.session.xmit_thread_priority = -20
Aug 10 01:04:21 user nova-compute[73029]: node.session.cmds_max = 128
Aug 10 01:04:21 user nova-compute[73029]: node.session.queue_depth = 32
Aug 10 01:04:21 user nova-compute[73029]: node.session.nr_sessions = 1
Aug 10 01:04:21 user nova-compute[73029]: node.session.auth.authmethod = CHAP
Aug 10 01:04:21 user nova-compute[73029]: node.session.auth.username = kcnMdoOy
Aug 10 01:04:21 user nova-compute[73029]: node.session.auth.password = ***
Aug 10 01:04:21 user nova-compute[73029]: node.session.auth.username_in = <empty>
Aug 10 01:04:21 user nova-compute[73029]: node.session.auth.password_in = <empty>
Aug 10 01:04:21 user nova-compute[73029]: node.session.auth.chap_algs = MD5
Aug 10 01:04:21 user nova-compute[73029]: node.session.timeo.replacement_timeout = 120
Aug 10 01:04:21 user nova-compute[73029]: node.session.err_timeo.abort_timeout = 15
Aug 10 01:04:21 user nova-compute[73029]: node.session.err_timeo.lu_reset_timeout = 30
Aug 10 01:04:21 user nova-compute[73029]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 10 01:04:21 user nova-compute[73029]: node.session.err_timeo.host_reset_timeout = 60
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.FastAbort = Yes
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.InitialR2T = No
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.ImmediateData = Yes
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.FirstBurstLength = 262144
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.MaxBurstLength = 16776192
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.DefaultTime2Retain = 0
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.DefaultTime2Wait = 2
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.MaxConnections = 1
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 10 01:04:21 user nova-compute[73029]: node.session.iscsi.ERL = 0
Aug 10 01:04:21 user nova-compute[73029]: node.session.scan = manual
Aug 10 01:04:21 user nova-compute[73029]: node.session.reopen_max = 0
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].address = 172.16.0.220
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].port = 3260
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].startup = manual
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].tcp.window_size = 524288
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].tcp.type_of_service = 0
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].timeo.logout_timeout = 15
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].timeo.login_timeout = 15
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].timeo.auth_timeout = 45
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].timeo.noop_out_interval = 5
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].timeo.noop_out_timeout = 5
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].iscsi.HeaderDigest = None
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].iscsi.DataDigest = None
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].iscsi.IFMarker = No
Aug 10 01:04:21 user nova-compute[73029]: node.conn[0].iscsi.OFMarker = No
Aug 10 01:04:21 user nova-compute[73029]: # END RECORD
Aug 10 01:04:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a08d3de-e38c-4d0f-9212-3d87b3083a6e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.181s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef1585-0ba7-412f-9f6c-4556be23a469]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kcnMdoOy {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kcnMdoOy" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c6c36-a475-46b2-be11-3f52aa3d0578]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kcnMdoOy'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66db51c-d75b-40b2-8cf1-6bb863de5c05]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[13690981-8d9e-460c-ad67-5be784edc968]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:04:21 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:04:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:04:21 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:04:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] HCTL ('33', '0', '0', 0) found on session 44 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9b3181-1437-4ebd-9275-19c9c364b009]: (4, ('0 0 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Searching for a device in session 44 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcnMdoOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.334s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] <== connect_volume: return (335ms) {'type': 'block', 'scsi_wwn': '23063633762343639', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063633762343639', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-889332447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-889332447',id=36,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-z2gzgybl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:02:52Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=93e11e7a-7de2-4783-a789-c2640267ce16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "vif_mac": "fa:16:3e:1c:c8:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "vif_mac": "fa:16:3e:1c:c8:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:c8:6c,bridge_name='br-int',has_traffic_filtering=True,id=5d0a86c1-b2a2-467c-a171-e02d5a5907fe,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0a86c1-b2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'pci_devices' on Instance uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:04:21 user nova-compute[73029]:   <uuid>93e11e7a-7de2-4783-a789-c2640267ce16</uuid>
Aug 10 01:04:21 user nova-compute[73029]:   <name>instance-00000024</name>
Aug 10 01:04:21 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:04:21 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:04:21 user nova-compute[73029]:   <metadata>
Aug 10 01:04:21 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:04:21 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:04:21 user nova-compute[73029]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-889332447</nova:name>
Aug 10 01:04:21 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:04:21</nova:creationTime>
Aug 10 01:04:21 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:04:21 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:04:21 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:04:21 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:04:21 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:04:21 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:04:21 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:04:21 user nova-compute[73029]:       <nova:owner>
Aug 10 01:04:21 user nova-compute[73029]:         <nova:user uuid="6d34a91746034f349b7eeccfd372f21a">tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member</nova:user>
Aug 10 01:04:21 user nova-compute[73029]:         <nova:project uuid="39027fdade2f41048db7d3855f3197cc">tempest-ServerBootFromVolumeStableRescueTest-1463443327</nova:project>
Aug 10 01:04:21 user nova-compute[73029]:       </nova:owner>
Aug 10 01:04:21 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:04:21 user nova-compute[73029]:       <nova:ports>
Aug 10 01:04:21 user nova-compute[73029]:         <nova:port uuid="5d0a86c1-b2a2-467c-a171-e02d5a5907fe">
Aug 10 01:04:21 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 01:04:21 user nova-compute[73029]:         </nova:port>
Aug 10 01:04:21 user nova-compute[73029]:       </nova:ports>
Aug 10 01:04:21 user nova-compute[73029]:     </nova:instance>
Aug 10 01:04:21 user nova-compute[73029]:   </metadata>
Aug 10 01:04:21 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:04:21 user nova-compute[73029]:     <system>
Aug 10 01:04:21 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:04:21 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:04:21 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:04:21 user nova-compute[73029]:       <entry name="serial">93e11e7a-7de2-4783-a789-c2640267ce16</entry>
Aug 10 01:04:21 user nova-compute[73029]:       <entry name="uuid">93e11e7a-7de2-4783-a789-c2640267ce16</entry>
Aug 10 01:04:21 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:04:21 user nova-compute[73029]:     </system>
Aug 10 01:04:21 user nova-compute[73029]:   </sysinfo>
Aug 10 01:04:21 user nova-compute[73029]:   <os>
Aug 10 01:04:21 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:04:21 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:04:21 user nova-compute[73029]:   </os>
Aug 10 01:04:21 user nova-compute[73029]:   <features>
Aug 10 01:04:21 user nova-compute[73029]:     <acpi/>
Aug 10 01:04:21 user nova-compute[73029]:     <apic/>
Aug 10 01:04:21 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:04:21 user nova-compute[73029]:   </features>
Aug 10 01:04:21 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:04:21 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:04:21 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:04:21 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:04:21 user nova-compute[73029]:   </clock>
Aug 10 01:04:21 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:04:21 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:04:21 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:04:21 user nova-compute[73029]:   </cpu>
Aug 10 01:04:21 user nova-compute[73029]:   <devices>
Aug 10 01:04:21 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:04:21 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:04:21 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 01:04:21 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:04:21 user nova-compute[73029]:       <serial>87c99c64-be34-4606-a27d-4ba5300ef961</serial>
Aug 10 01:04:21 user nova-compute[73029]:     </disk>
Aug 10 01:04:21 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:04:21 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:04:21 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue"/>
Aug 10 01:04:21 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 01:04:21 user nova-compute[73029]:       <boot order="1"/>
Aug 10 01:04:21 user nova-compute[73029]:     </disk>
Aug 10 01:04:21 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:04:21 user nova-compute[73029]:       <mac address="fa:16:3e:1c:c8:6c"/>
Aug 10 01:04:21 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:04:21 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:04:21 user nova-compute[73029]:       <target dev="tap5d0a86c1-b2"/>
Aug 10 01:04:21 user nova-compute[73029]:     </interface>
Aug 10 01:04:21 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:04:21 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/console.log" append="off"/>
Aug 10 01:04:21 user nova-compute[73029]:     </serial>
Aug 10 01:04:21 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:04:21 user nova-compute[73029]:     <video>
Aug 10 01:04:21 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:04:21 user nova-compute[73029]:     </video>
Aug 10 01:04:21 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:04:21 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:04:21 user nova-compute[73029]:     </rng>
Aug 10 01:04:21 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:04:21 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:04:21 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:04:21 user nova-compute[73029]:     </memballoon>
Aug 10 01:04:21 user nova-compute[73029]:   </devices>
Aug 10 01:04:21 user nova-compute[73029]: </domain>
Aug 10 01:04:21 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:04:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Instance destroyed successfully.
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:04:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] No VIF found with MAC fa:16:3e:1c:c8:6c, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:04:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-c4e76c6c-26dc-4328-b793-adae75a6542d req-32ec1c7f-81d2-4f61-b227-86a22284b028 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:04:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c4e76c6c-26dc-4328-b793-adae75a6542d req-32ec1c7f-81d2-4f61-b227-86a22284b028 service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c4e76c6c-26dc-4328-b793-adae75a6542d req-32ec1c7f-81d2-4f61-b227-86a22284b028 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c4e76c6c-26dc-4328-b793-adae75a6542d req-32ec1c7f-81d2-4f61-b227-86a22284b028 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-c4e76c6c-26dc-4328-b793-adae75a6542d req-32ec1c7f-81d2-4f61-b227-86a22284b028 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:04:23 user nova-compute[73029]: WARNING nova.compute.manager [req-c4e76c6c-26dc-4328-b793-adae75a6542d req-32ec1c7f-81d2-4f61-b227-86a22284b028 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state active and task_state rescuing.
Aug 10 01:04:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 93e11e7a-7de2-4783-a789-c2640267ce16 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 01:04:24 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629464.9402936, 93e11e7a-7de2-4783-a789-c2640267ce16 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:04:24 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] VM Resumed (Lifecycle Event)
Aug 10 01:04:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-f7dbe101-6a44-4546-a930-75fa74f46108 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:04:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:04:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:04:24 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 10 01:04:24 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629464.944388, 93e11e7a-7de2-4783-a789-c2640267ce16 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:04:24 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] VM Started (Lifecycle Event)
Aug 10 01:04:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:04:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:04:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-72ba70b7-9017-4dc3-a2c1-74a8a75ac2f1 req-775c8944-85d2-4281-a78a-c11b08888f7c service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:04:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-72ba70b7-9017-4dc3-a2c1-74a8a75ac2f1 req-775c8944-85d2-4281-a78a-c11b08888f7c service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-72ba70b7-9017-4dc3-a2c1-74a8a75ac2f1 req-775c8944-85d2-4281-a78a-c11b08888f7c service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-72ba70b7-9017-4dc3-a2c1-74a8a75ac2f1 req-775c8944-85d2-4281-a78a-c11b08888f7c service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-72ba70b7-9017-4dc3-a2c1-74a8a75ac2f1 req-775c8944-85d2-4281-a78a-c11b08888f7c service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:04:25 user nova-compute[73029]: WARNING nova.compute.manager [req-72ba70b7-9017-4dc3-a2c1-74a8a75ac2f1 req-775c8944-85d2-4281-a78a-c11b08888f7c service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state rescued and task_state None.
Aug 10 01:04:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:04:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:04:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:04:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:04:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:04:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:04:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Updating instance_info_cache with network_info: [{"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:04:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:04:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:04:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:04:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:04:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:04:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:04:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:04:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:04:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:41 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:04:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:04:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:04:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:43 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:04:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:04:46 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:04:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8350MB free_disk=24.978103637695312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 93e11e7a-7de2-4783-a789-c2640267ce16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:04:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-46b16bb5-82a1-48c5-971f-fdb37ebb174c req-3c9928cd-abca-4db6-85c0-8945de3cd8bc service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-changed-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG nova.compute.manager [req-46b16bb5-82a1-48c5-971f-fdb37ebb174c req-3c9928cd-abca-4db6-85c0-8945de3cd8bc service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Refreshing instance network info cache due to event network-changed-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46b16bb5-82a1-48c5-971f-fdb37ebb174c req-3c9928cd-abca-4db6-85c0-8945de3cd8bc service nova] Acquiring lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46b16bb5-82a1-48c5-971f-fdb37ebb174c req-3c9928cd-abca-4db6-85c0-8945de3cd8bc service nova] Acquired lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:04:47 user nova-compute[73029]: DEBUG nova.network.neutron [req-46b16bb5-82a1-48c5-971f-fdb37ebb174c req-3c9928cd-abca-4db6-85c0-8945de3cd8bc service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Refreshing network info cache for port 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:04:48 user nova-compute[73029]: DEBUG nova.network.neutron [req-46b16bb5-82a1-48c5-971f-fdb37ebb174c req-3c9928cd-abca-4db6-85c0-8945de3cd8bc service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updated VIF entry in instance network info cache for port 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:04:48 user nova-compute[73029]: DEBUG nova.network.neutron [req-46b16bb5-82a1-48c5-971f-fdb37ebb174c req-3c9928cd-abca-4db6-85c0-8945de3cd8bc service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating instance_info_cache with network_info: [{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:04:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46b16bb5-82a1-48c5-971f-fdb37ebb174c req-3c9928cd-abca-4db6-85c0-8945de3cd8bc service nova] Releasing lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:04:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:04:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:52 user nova-compute[73029]: INFO nova.compute.manager [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Shelving
Aug 10 01:04:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-665dc952-198f-4a99-ad12-e7e8c66ace75 req-c7cf2c51-fe66-4ef6-aa55-f91fe75106ff service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-unplugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:04:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-665dc952-198f-4a99-ad12-e7e8c66ace75 req-c7cf2c51-fe66-4ef6-aa55-f91fe75106ff service nova] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-665dc952-198f-4a99-ad12-e7e8c66ace75 req-c7cf2c51-fe66-4ef6-aa55-f91fe75106ff service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-665dc952-198f-4a99-ad12-e7e8c66ace75 req-c7cf2c51-fe66-4ef6-aa55-f91fe75106ff service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-665dc952-198f-4a99-ad12-e7e8c66ace75 req-c7cf2c51-fe66-4ef6-aa55-f91fe75106ff service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] No waiting events found dispatching network-vif-unplugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:04:53 user nova-compute[73029]: WARNING nova.compute.manager [req-665dc952-198f-4a99-ad12-e7e8c66ace75 req-c7cf2c51-fe66-4ef6-aa55-f91fe75106ff service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received unexpected event network-vif-unplugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf for instance with vm_state active and task_state shelving.
Aug 10 01:04:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance destroyed successfully.
Aug 10 01:04:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Beginning cold snapshot process
Aug 10 01:04:53 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 01:04:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk /opt/stack/data/nova/instances/snapshots/tmp8fzbq5yt/c908df52f4a14ab2aa2f60a5ca5206e6 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:04:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk /opt/stack/data/nova/instances/snapshots/tmp8fzbq5yt/c908df52f4a14ab2aa2f60a5ca5206e6" returned: 0 in 0.559s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:04:54 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Snapshot extracted, beginning image upload
Aug 10 01:04:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-e193e13d-d298-4eb2-8a00-37e72be52d39 req-f0e294a4-1556-4a90-94be-f7957cee9643 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:04:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e193e13d-d298-4eb2-8a00-37e72be52d39 req-f0e294a4-1556-4a90-94be-f7957cee9643 service nova] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e193e13d-d298-4eb2-8a00-37e72be52d39 req-f0e294a4-1556-4a90-94be-f7957cee9643 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e193e13d-d298-4eb2-8a00-37e72be52d39 req-f0e294a4-1556-4a90-94be-f7957cee9643 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-e193e13d-d298-4eb2-8a00-37e72be52d39 req-f0e294a4-1556-4a90-94be-f7957cee9643 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] No waiting events found dispatching network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:04:55 user nova-compute[73029]: WARNING nova.compute.manager [req-e193e13d-d298-4eb2-8a00-37e72be52d39 req-f0e294a4-1556-4a90-94be-f7957cee9643 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received unexpected event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf for instance with vm_state active and task_state shelving_image_uploading.
Aug 10 01:04:56 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Snapshot image upload complete
Aug 10 01:04:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:04:56 user nova-compute[73029]: INFO nova.compute.manager [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Shelve offloading
Aug 10 01:04:56 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance destroyed successfully.
Aug 10 01:04:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:04:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:04:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquired lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:04:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating instance_info_cache with network_info: [{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Releasing lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:04:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance destroyed successfully.
Aug 10 01:04:57 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'resources' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1833026875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1833026875',id=37,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEGdNiwx5QbPl7vlPccwSGe70dJI33VDMaLMH86viCzaIqe6Ww1es4Ta9D5hunhHT8FNMAbuCzsJpwkfMgC93tfQOL7K/UqLwCidUygGmNMdkDso7AY0IPTVmNeEvSzLw==',key_name='tempest-keypair-1337121988',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:03:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-50czkq8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member',shelved_at='2023-08-10T01:04:56.612013',shelved_host='user',shelved_image_id='8a39ec89-7e89-47f6-ae53-a59877be84b9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=453a13a0-f725-4bc0-9ff2-c8dee38cad41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG os_vif [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f6bfbc9-b8, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-790386ec-46ee-4840-8a1d-99c4369c0003 req-34d9dd57-a510-41ed-a9a3-1864aa52e4e9 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-changed-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG nova.compute.manager [req-790386ec-46ee-4840-8a1d-99c4369c0003 req-34d9dd57-a510-41ed-a9a3-1864aa52e4e9 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Refreshing instance network info cache due to event network-changed-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-790386ec-46ee-4840-8a1d-99c4369c0003 req-34d9dd57-a510-41ed-a9a3-1864aa52e4e9 service nova] Acquiring lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-790386ec-46ee-4840-8a1d-99c4369c0003 req-34d9dd57-a510-41ed-a9a3-1864aa52e4e9 service nova] Acquired lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-790386ec-46ee-4840-8a1d-99c4369c0003 req-34d9dd57-a510-41ed-a9a3-1864aa52e4e9 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Refreshing network info cache for port 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:04:57 user nova-compute[73029]: INFO os_vif [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8')
Aug 10 01:04:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Deleting instance files /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41_del
Aug 10 01:04:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Deletion of /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41_del complete
Aug 10 01:04:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:04:58 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Deleted allocations for instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41
Aug 10 01:04:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:04:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:04:58 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'numa_topology' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:04:58 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:04:58 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:04:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a5e2a902-3dca-4a74-859c-c96c79780912 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.760s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:04:58 user nova-compute[73029]: DEBUG nova.network.neutron [req-790386ec-46ee-4840-8a1d-99c4369c0003 req-34d9dd57-a510-41ed-a9a3-1864aa52e4e9 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updated VIF entry in instance network info cache for port 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:04:58 user nova-compute[73029]: DEBUG nova.network.neutron [req-790386ec-46ee-4840-8a1d-99c4369c0003 req-34d9dd57-a510-41ed-a9a3-1864aa52e4e9 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating instance_info_cache with network_info: [{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:04:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-790386ec-46ee-4840-8a1d-99c4369c0003 req-34d9dd57-a510-41ed-a9a3-1864aa52e4e9 service nova] Releasing lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:05:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:08 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629493.495527, 453a13a0-f725-4bc0-9ff2-c8dee38cad41 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:05:08 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] VM Stopped (Lifecycle Event)
Aug 10 01:05:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-809f5126-d0b6-4b88-abe8-5d5179fff354 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:05:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:05:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 1c23f226-a16a-4158-bac9-b9d78381fb5c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updating instance_info_cache with network_info: [{"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:05:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:05:40 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:40 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:41 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:05:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:44 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:44 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:44 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:05:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:05:47 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:05:47 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8604MB free_disk=24.955707550048828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 93e11e7a-7de2-4783-a789-c2640267ce16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:05:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:05:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:05:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:06:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:07 user nova-compute[73029]: INFO nova.compute.manager [None req-cc5f4993-04dd-4378-b6a4-6f2d844cbd0b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Unrescuing
Aug 10 01:06:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cc5f4993-04dd-4378-b6a4-6f2d844cbd0b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:06:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cc5f4993-04dd-4378-b6a4-6f2d844cbd0b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquired lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:06:07 user nova-compute[73029]: DEBUG nova.network.neutron [None req-cc5f4993-04dd-4378-b6a4-6f2d844cbd0b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG nova.network.neutron [None req-cc5f4993-04dd-4378-b6a4-6f2d844cbd0b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Updating instance_info_cache with network_info: [{"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cc5f4993-04dd-4378-b6a4-6f2d844cbd0b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Releasing lock "refresh_cache-93e11e7a-7de2-4783-a789-c2640267ce16" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-cc5f4993-04dd-4378-b6a4-6f2d844cbd0b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'flavor' on Instance uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-ae8d3a1b-6842-44ff-8c57-014d147547d1 req-ce62d46a-178f-4e30-8bdd-630d2927947c service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-unplugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ae8d3a1b-6842-44ff-8c57-014d147547d1 req-ce62d46a-178f-4e30-8bdd-630d2927947c service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ae8d3a1b-6842-44ff-8c57-014d147547d1 req-ce62d46a-178f-4e30-8bdd-630d2927947c service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ae8d3a1b-6842-44ff-8c57-014d147547d1 req-ce62d46a-178f-4e30-8bdd-630d2927947c service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-ae8d3a1b-6842-44ff-8c57-014d147547d1 req-ce62d46a-178f-4e30-8bdd-630d2927947c service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-unplugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:06:08 user nova-compute[73029]: WARNING nova.compute.manager [req-ae8d3a1b-6842-44ff-8c57-014d147547d1 req-ce62d46a-178f-4e30-8bdd-630d2927947c service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-unplugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state rescued and task_state unrescuing.
Aug 10 01:06:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:09 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Instance destroyed successfully.
Aug 10 01:06:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:06:10 user nova-compute[73029]: WARNING nova.compute.manager [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state rescued and task_state unrescuing.
Aug 10 01:06:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:06:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:06:10 user nova-compute[73029]: WARNING nova.compute.manager [req-aa8fbbfe-bdc0-4a22-8587-58fce5e76465 req-f545c4b2-88fa-4781-9b49-59072fa94b56 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state rescued and task_state unrescuing.
Aug 10 01:06:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Removed pending event for 93e11e7a-7de2-4783-a789-c2640267ce16 due to event {{(pid=73029) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 10 01:06:12 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629572.6621957, 93e11e7a-7de2-4783-a789-c2640267ce16 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:06:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] VM Resumed (Lifecycle Event)
Aug 10 01:06:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-cc5f4993-04dd-4378-b6a4-6f2d844cbd0b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:06:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:06:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:06:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 10 01:06:12 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629572.6643293, 93e11e7a-7de2-4783-a789-c2640267ce16 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:06:12 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] VM Started (Lifecycle Event)
Aug 10 01:06:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:06:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:06:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-5730b458-f4e9-4936-a2c1-6ccd1c08d9bb req-a161c609-bc2a-4f25-b953-efc2f6cffd1e service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:06:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5730b458-f4e9-4936-a2c1-6ccd1c08d9bb req-a161c609-bc2a-4f25-b953-efc2f6cffd1e service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:06:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5730b458-f4e9-4936-a2c1-6ccd1c08d9bb req-a161c609-bc2a-4f25-b953-efc2f6cffd1e service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:06:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5730b458-f4e9-4936-a2c1-6ccd1c08d9bb req-a161c609-bc2a-4f25-b953-efc2f6cffd1e service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:06:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-5730b458-f4e9-4936-a2c1-6ccd1c08d9bb req-a161c609-bc2a-4f25-b953-efc2f6cffd1e service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:06:13 user nova-compute[73029]: WARNING nova.compute.manager [req-5730b458-f4e9-4936-a2c1-6ccd1c08d9bb req-a161c609-bc2a-4f25-b953-efc2f6cffd1e service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state active and task_state None.
Aug 10 01:06:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:06:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:06:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:06:39 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:06:39 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updating instance_info_cache with network_info: [{"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:06:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-3d6ce28c-39f0-432c-bfe3-a5891fb69021" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:06:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:06:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:43 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:43 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:06:45 user nova-compute[73029]: INFO nova.compute.manager [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Unshelving
Aug 10 01:06:45 user nova-compute[73029]: INFO nova.virt.block_device [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Booting with volume 3bf07bd8-5f36-4bed-84bc-9e93af5268c9 at /dev/vdc
Aug 10 01:06:45 user nova-compute[73029]: DEBUG os_brick.utils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e43130c-f4fe-469f-a6cc-346bca44e6c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8decc2-ad96-45aa-9273-935f318f2a70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[74163610-d78e-4edb-af05-e0aa01584f27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5a95e4-440b-4991-986f-88d80f4dab55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:06:45 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:06:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dbc9ba-1027-464e-bbe9-c375946ee4d3]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG os_brick.utils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:06:45 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating existing volume attachment record: 96c81ef1-2d50-447e-a194-857f4fb942bf {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:06:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:06:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:06:48 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:06:48 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8524MB free_disk=24.955692291259766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 93e11e7a-7de2-4783-a789-c2640267ce16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:06:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:06:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:06:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:06:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:06:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:06:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:06:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:06:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:06:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:06:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:06:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:06:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:06:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:06:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:06:59 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'pci_requests' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:06:59 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'numa_topology' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:06:59 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:06:59 user nova-compute[73029]: INFO nova.compute.claims [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Claim successful on node user
Aug 10 01:07:00 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:07:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:07:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:00 user nova-compute[73029]: INFO nova.network.neutron [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating port 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 10 01:07:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquired lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-2ec89821-6f30-4bd5-99c5-2cc1eed3d83e req-8906941c-0f13-4ca5-b182-40ef2fa42ba3 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-changed-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-2ec89821-6f30-4bd5-99c5-2cc1eed3d83e req-8906941c-0f13-4ca5-b182-40ef2fa42ba3 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Refreshing instance network info cache due to event network-changed-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2ec89821-6f30-4bd5-99c5-2cc1eed3d83e req-8906941c-0f13-4ca5-b182-40ef2fa42ba3 service nova] Acquiring lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG nova.network.neutron [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating instance_info_cache with network_info: [{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Releasing lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:07:01 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Creating image(s)
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'trusted_certs' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2ec89821-6f30-4bd5-99c5-2cc1eed3d83e req-8906941c-0f13-4ca5-b182-40ef2fa42ba3 service nova] Acquired lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG nova.network.neutron [req-2ec89821-6f30-4bd5-99c5-2cc1eed3d83e req-8906941c-0f13-4ca5-b182-40ef2fa42ba3 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Refreshing network info cache for port 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "bc3de84a9e20267a6555ed6473a8bc77d070723e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "bc3de84a9e20267a6555ed6473a8bc77d070723e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e.part --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:02 user nova-compute[73029]: DEBUG nova.virt.images [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] 8a39ec89-7e89-47f6-ae53-a59877be84b9 was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 01:07:02 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 01:07:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e.part /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:02 user nova-compute[73029]: DEBUG nova.network.neutron [req-2ec89821-6f30-4bd5-99c5-2cc1eed3d83e req-8906941c-0f13-4ca5-b182-40ef2fa42ba3 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updated VIF entry in instance network info cache for port 1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:07:02 user nova-compute[73029]: DEBUG nova.network.neutron [req-2ec89821-6f30-4bd5-99c5-2cc1eed3d83e req-8906941c-0f13-4ca5-b182-40ef2fa42ba3 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating instance_info_cache with network_info: [{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:07:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2ec89821-6f30-4bd5-99c5-2cc1eed3d83e req-8906941c-0f13-4ca5-b182-40ef2fa42ba3 service nova] Releasing lock "refresh_cache-453a13a0-f725-4bc0-9ff2-c8dee38cad41" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e.part /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e.converted" returned: 0 in 0.428s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "bc3de84a9e20267a6555ed6473a8bc77d070723e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.728s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "bc3de84a9e20267a6555ed6473a8bc77d070723e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "bc3de84a9e20267a6555ed6473a8bc77d070723e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e,backing_fmt=raw /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e,backing_fmt=raw /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk 1073741824" returned: 0 in 0.053s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "bc3de84a9e20267a6555ed6473a8bc77d070723e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'migration_context' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:07:03 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Rebasing disk image.
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf -F raw /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf -F raw /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk" returned: 0 in 2.116s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:07:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Ensure instance console log exists: /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:07:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Start _get_guest_xml network_info=[{"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='9edd38e15ab5b4f131c2a55dfc126c3c',container_format='bare',created_at=2023-08-10T01:04:53Z,direct_url=<?>,disk_format='qcow2',id=8a39ec89-7e89-47f6-ae53-a59877be84b9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1833026875-shelved',owner='6ed8b4d1eded488da4e1dc7c699bf32b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-10T01:04:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '96c81ef1-2d50-447e-a194-857f4fb942bf', 'boot_index': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXodlEkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '453a13a0-f725-4bc0-9ff2-c8dee38cad41', 'attached_at': '', 'detached_at': '', 'volume_id': '3bf07bd8-5f36-4bed-84bc-9e93af5268c9', 'serial': '3bf07bd8-5f36-4bed-84bc-9e93af5268c9'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:07:05 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:07:05 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:07:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9edd38e15ab5b4f131c2a55dfc126c3c',container_format='bare',created_at=2023-08-10T01:04:53Z,direct_url=<?>,disk_format='qcow2',id=8a39ec89-7e89-47f6-ae53-a59877be84b9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1833026875-shelved',owner='6ed8b4d1eded488da4e1dc7c699bf32b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-10T01:04:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'vcpu_model' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXodlEkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:07:06 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:07:06 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:07:06 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7505f0fd-b5cf-44a2-ae0f-f467f43aff0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:07:06 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5e556-44ba-4931-9261-408fe51dd490]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9] added
Aug 10 01:07:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f66bc9b-045a-4db9-a9be-0337cbc2471d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[900322b2-9030-4075-89a1-0aec8acafa59]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXodlEkD {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXodlEkD" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5806852-53da-4660-8097-009eba69981d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MXodlEkD'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b0ca4-bd53-4e55-8850-edec1f2a1a64]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb46c93f-7f46-4787-8967-16e279b67ad1]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:07:06 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:07:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:07:06 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:07:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff953649-ae02-44a2-9de1-0a9f9455b2d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9, portal: 172.16.0.220,3260]
Aug 10 01:07:06 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9, portal: 172.16.0.220,3260] successful.
Aug 10 01:07:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a100cfa-8c8a-4658-91dc-5c16da8ee2e0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fd0285-1dc9-418b-8b9d-f17ef2afaf0c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:07:06 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:07:06 user nova-compute[73029]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 (non-flash)
Aug 10 01:07:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:07:06 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:07:06 user nova-compute[73029]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 (non-flash)
Aug 10 01:07:06 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cdfc3a-34f8-42a7-b136-d2fcb72b4ba6]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXodlEkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26561383335336638', 'path': '/dev/sdd'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561383335336638', 'path': '/dev/sdd'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T01:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1833026875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1833026875',id=37,image_ref='8a39ec89-7e89-47f6-ae53-a59877be84b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1337121988',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:03:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-50czkq8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member',shelved_at='2023-08-10T01:04:56.612013',shelved_host='user',shelved_image_id='8a39ec89-7e89-47f6-ae53-a59877be84b9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=453a13a0-f725-4bc0-9ff2-c8dee38cad41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'pci_devices' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:07:07 user nova-compute[73029]:   <uuid>453a13a0-f725-4bc0-9ff2-c8dee38cad41</uuid>
Aug 10 01:07:07 user nova-compute[73029]:   <name>instance-00000025</name>
Aug 10 01:07:07 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:07:07 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:07:07 user nova-compute[73029]:   <metadata>
Aug 10 01:07:07 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:07:07 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:07:07 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1833026875</nova:name>
Aug 10 01:07:07 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:07:05</nova:creationTime>
Aug 10 01:07:07 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:07:07 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:07:07 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:07:07 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:07:07 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:07:07 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:07:07 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:07:07 user nova-compute[73029]:       <nova:owner>
Aug 10 01:07:07 user nova-compute[73029]:         <nova:user uuid="45605bba94154ec797f1be53cd778876">tempest-AttachVolumeShelveTestJSON-2077435926-project-member</nova:user>
Aug 10 01:07:07 user nova-compute[73029]:         <nova:project uuid="6ed8b4d1eded488da4e1dc7c699bf32b">tempest-AttachVolumeShelveTestJSON-2077435926</nova:project>
Aug 10 01:07:07 user nova-compute[73029]:       </nova:owner>
Aug 10 01:07:07 user nova-compute[73029]:       <nova:root type="image" uuid="8a39ec89-7e89-47f6-ae53-a59877be84b9"/>
Aug 10 01:07:07 user nova-compute[73029]:       <nova:ports>
Aug 10 01:07:07 user nova-compute[73029]:         <nova:port uuid="1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf">
Aug 10 01:07:07 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 10 01:07:07 user nova-compute[73029]:         </nova:port>
Aug 10 01:07:07 user nova-compute[73029]:       </nova:ports>
Aug 10 01:07:07 user nova-compute[73029]:     </nova:instance>
Aug 10 01:07:07 user nova-compute[73029]:   </metadata>
Aug 10 01:07:07 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:07:07 user nova-compute[73029]:     <system>
Aug 10 01:07:07 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:07:07 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:07:07 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:07:07 user nova-compute[73029]:       <entry name="serial">453a13a0-f725-4bc0-9ff2-c8dee38cad41</entry>
Aug 10 01:07:07 user nova-compute[73029]:       <entry name="uuid">453a13a0-f725-4bc0-9ff2-c8dee38cad41</entry>
Aug 10 01:07:07 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:07:07 user nova-compute[73029]:     </system>
Aug 10 01:07:07 user nova-compute[73029]:   </sysinfo>
Aug 10 01:07:07 user nova-compute[73029]:   <os>
Aug 10 01:07:07 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:07:07 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:07:07 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:07:07 user nova-compute[73029]:   </os>
Aug 10 01:07:07 user nova-compute[73029]:   <features>
Aug 10 01:07:07 user nova-compute[73029]:     <acpi/>
Aug 10 01:07:07 user nova-compute[73029]:     <apic/>
Aug 10 01:07:07 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:07:07 user nova-compute[73029]:   </features>
Aug 10 01:07:07 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:07:07 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:07:07 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:07:07 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:07:07 user nova-compute[73029]:   </clock>
Aug 10 01:07:07 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:07:07 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:07:07 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:07:07 user nova-compute[73029]:   </cpu>
Aug 10 01:07:07 user nova-compute[73029]:   <devices>
Aug 10 01:07:07 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:07:07 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:07:07 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk"/>
Aug 10 01:07:07 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:07:07 user nova-compute[73029]:     </disk>
Aug 10 01:07:07 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:07:07 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:07:07 user nova-compute[73029]:       <source dev="/dev/sdd"/>
Aug 10 01:07:07 user nova-compute[73029]:       <target dev="vdc" bus="virtio"/>
Aug 10 01:07:07 user nova-compute[73029]:       <serial>3bf07bd8-5f36-4bed-84bc-9e93af5268c9</serial>
Aug 10 01:07:07 user nova-compute[73029]:     </disk>
Aug 10 01:07:07 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:07:07 user nova-compute[73029]:       <mac address="fa:16:3e:29:44:d2"/>
Aug 10 01:07:07 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:07:07 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:07:07 user nova-compute[73029]:       <target dev="tap1f6bfbc9-b8"/>
Aug 10 01:07:07 user nova-compute[73029]:     </interface>
Aug 10 01:07:07 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:07:07 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/console.log" append="off"/>
Aug 10 01:07:07 user nova-compute[73029]:     </serial>
Aug 10 01:07:07 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:07:07 user nova-compute[73029]:     <video>
Aug 10 01:07:07 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:07:07 user nova-compute[73029]:     </video>
Aug 10 01:07:07 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:07:07 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:07:07 user nova-compute[73029]:     </rng>
Aug 10 01:07:07 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:07:07 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:07:07 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:07:07 user nova-compute[73029]:     </memballoon>
Aug 10 01:07:07 user nova-compute[73029]:   </devices>
Aug 10 01:07:07 user nova-compute[73029]: </domain>
Aug 10 01:07:07 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T01:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1833026875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1833026875',id=37,image_ref='8a39ec89-7e89-47f6-ae53-a59877be84b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1337121988',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:03:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-50czkq8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member',shelved_at='2023-08-10T01:04:56.612013',shelved_host='user',shelved_image_id='8a39ec89-7e89-47f6-ae53-a59877be84b9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=453a13a0-f725-4bc0-9ff2-c8dee38cad41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG os_vif [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f6bfbc9-b8, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f6bfbc9-b8, col_values=(('external_ids', {'iface-id': '1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:44:d2', 'vm-uuid': '453a13a0-f725-4bc0-9ff2-c8dee38cad41'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:07 user nova-compute[73029]: INFO os_vif [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8')
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:07:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] No VIF found with MAC fa:16:3e:29:44:d2, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:07:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-d38075f4-2e3c-45a3-bd49-0560b1d0c9f0 req-5ceabaa1-44f1-4c41-b552-c4c3e25164a6 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:07:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d38075f4-2e3c-45a3-bd49-0560b1d0c9f0 req-5ceabaa1-44f1-4c41-b552-c4c3e25164a6 service nova] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d38075f4-2e3c-45a3-bd49-0560b1d0c9f0 req-5ceabaa1-44f1-4c41-b552-c4c3e25164a6 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d38075f4-2e3c-45a3-bd49-0560b1d0c9f0 req-5ceabaa1-44f1-4c41-b552-c4c3e25164a6 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-d38075f4-2e3c-45a3-bd49-0560b1d0c9f0 req-5ceabaa1-44f1-4c41-b552-c4c3e25164a6 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] No waiting events found dispatching network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:07:09 user nova-compute[73029]: WARNING nova.compute.manager [req-d38075f4-2e3c-45a3-bd49-0560b1d0c9f0 req-5ceabaa1-44f1-4c41-b552-c4c3e25164a6 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received unexpected event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf for instance with vm_state shelved_offloaded and task_state spawning.
Aug 10 01:07:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:10 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629630.8598864, 453a13a0-f725-4bc0-9ff2-c8dee38cad41 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:07:10 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] VM Resumed (Lifecycle Event)
Aug 10 01:07:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:07:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:07:10 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance spawned successfully.
Aug 10 01:07:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:07:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:07:10 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:07:10 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629630.8614044, 453a13a0-f725-4bc0-9ff2-c8dee38cad41 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:07:10 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] VM Started (Lifecycle Event)
Aug 10 01:07:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:07:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:07:10 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:07:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:07:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a1ce623d-c0ab-4ea7-88d3-5e718926e088 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.944s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-87563efd-9268-48d2-ace2-cc08d6962c6b req-1d29e388-5dfd-417e-8b12-a3bd997e849d service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:07:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-87563efd-9268-48d2-ace2-cc08d6962c6b req-1d29e388-5dfd-417e-8b12-a3bd997e849d service nova] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-87563efd-9268-48d2-ace2-cc08d6962c6b req-1d29e388-5dfd-417e-8b12-a3bd997e849d service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-87563efd-9268-48d2-ace2-cc08d6962c6b req-1d29e388-5dfd-417e-8b12-a3bd997e849d service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-87563efd-9268-48d2-ace2-cc08d6962c6b req-1d29e388-5dfd-417e-8b12-a3bd997e849d service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] No waiting events found dispatching network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:07:11 user nova-compute[73029]: WARNING nova.compute.manager [req-87563efd-9268-48d2-ace2-cc08d6962c6b req-1d29e388-5dfd-417e-8b12-a3bd997e849d service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received unexpected event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf for instance with vm_state active and task_state None.
Aug 10 01:07:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:07:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:07:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:07:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:07:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:07:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:07:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:40 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:07:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:07:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:07:40 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:07:40 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Updating instance_info_cache with network_info: [{"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:07:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-eb392795-1e14-4753-b0e3-0971ab34e369" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:07:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:07:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:44 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:07:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:07:48 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:07:48 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8433MB free_disk=24.92938995361328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 93e11e7a-7de2-4783-a789-c2640267ce16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:07:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:07:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:07:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:07:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:07:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:07:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:07:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:07:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:07:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:07:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "93e11e7a-7de2-4783-a789-c2640267ce16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:58 user nova-compute[73029]: INFO nova.compute.manager [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Terminating instance
Aug 10 01:07:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-924e38e6-8526-4bdb-966d-d8b25393912e req-064ee34b-832b-4476-a5da-b59c39fb31e1 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-unplugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-924e38e6-8526-4bdb-966d-d8b25393912e req-064ee34b-832b-4476-a5da-b59c39fb31e1 service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-924e38e6-8526-4bdb-966d-d8b25393912e req-064ee34b-832b-4476-a5da-b59c39fb31e1 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-924e38e6-8526-4bdb-966d-d8b25393912e req-064ee34b-832b-4476-a5da-b59c39fb31e1 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-924e38e6-8526-4bdb-966d-d8b25393912e req-064ee34b-832b-4476-a5da-b59c39fb31e1 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-unplugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-924e38e6-8526-4bdb-966d-d8b25393912e req-064ee34b-832b-4476-a5da-b59c39fb31e1 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-unplugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Instance destroyed successfully.
Aug 10 01:07:59 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'resources' on Instance uuid 93e11e7a-7de2-4783-a789-c2640267ce16 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-889332447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-889332447',id=36,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-z2gzgybl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:06:13Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=93e11e7a-7de2-4783-a789-c2640267ce16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "address": "fa:16:3e:1c:c8:6c", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0a86c1-b2", "ovs_interfaceid": "5d0a86c1-b2a2-467c-a171-e02d5a5907fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:c8:6c,bridge_name='br-int',has_traffic_filtering=True,id=5d0a86c1-b2a2-467c-a171-e02d5a5907fe,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0a86c1-b2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_vif [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:c8:6c,bridge_name='br-int',has_traffic_filtering=True,id=5d0a86c1-b2a2-467c-a171-e02d5a5907fe,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0a86c1-b2') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d0a86c1-b2, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:07:59 user nova-compute[73029]: INFO os_vif [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:c8:6c,bridge_name='br-int',has_traffic_filtering=True,id=5d0a86c1-b2a2-467c-a171-e02d5a5907fe,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0a86c1-b2')
Aug 10 01:07:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcnMdoOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:07:59 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab314079-6dbd-4d8e-8a9f-406d5f854b1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c219571-b480-4045-941c-d919b99dd10e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:07:59 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:07:59 user nova-compute[73029]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 (non-flash)
Aug 10 01:07:59 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:07:59 user nova-compute[73029]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 (non-flash)
Aug 10 01:07:59 user nova-compute[73029]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 (non-flash)
Aug 10 01:07:59 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751c23ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c139ee99-31e9-4503-970c-7e083d35139b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6216d8f9-0d75-4d3c-a2c9-50cba5f83767]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1df340e-863c-47fb-b84f-1863be7ea404]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7672b1e2-6f16-4514-878b-ff755c174d84]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ca81eb-7dbb-47e1-9f95-baaae445e000]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:07:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3a936-c9a5-4339-bfa4-df1d1d2bd4df]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961, portal: 172.16.0.220,3260]
Aug 10 01:08:00 user nova-compute[73029]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961, portal: 172.16.0.220,3260] successful.
Aug 10 01:08:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c99c64-be34-4606-a27d-4ba5300ef961 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1556af61-48fb-4988-9590-5aa8fb2067b6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] <== disconnect_volume: return (304ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:08:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Deleting instance files /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16_del
Aug 10 01:08:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Deletion of /opt/stack/data/nova/instances/93e11e7a-7de2-4783-a789-c2640267ce16_del complete
Aug 10 01:08:00 user nova-compute[73029]: INFO nova.compute.manager [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 10 01:08:00 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:08:00 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Took 0.50 seconds to deallocate network for instance.
Aug 10 01:08:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-9ae44abe-ec32-42c1-b67b-10813358ba81 req-1ab63901-7bf1-4fd1-b912-f3134460fecb service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-deleted-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:08:00 user nova-compute[73029]: INFO nova.compute.manager [req-9ae44abe-ec32-42c1-b67b-10813358ba81 req-1ab63901-7bf1-4fd1-b912-f3134460fecb service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Neutron deleted interface 5d0a86c1-b2a2-467c-a171-e02d5a5907fe; detaching it from the instance and deleting it from the info cache
Aug 10 01:08:00 user nova-compute[73029]: DEBUG nova.network.neutron [req-9ae44abe-ec32-42c1-b67b-10813358ba81 req-1ab63901-7bf1-4fd1-b912-f3134460fecb service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:08:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-9ae44abe-ec32-42c1-b67b-10813358ba81 req-1ab63901-7bf1-4fd1-b912-f3134460fecb service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Detach interface failed, port_id=5d0a86c1-b2a2-467c-a171-e02d5a5907fe, reason: Instance 93e11e7a-7de2-4783-a789-c2640267ce16 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 01:08:01 user nova-compute[73029]: INFO nova.compute.manager [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Took 0.74 seconds to detach 1 volumes for instance.
Aug 10 01:08:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-4fb81dfc-7d78-4149-a670-710487e3d75c req-4fe09a47-5810-493a-8b5f-ad28b0965653 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:08:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4fb81dfc-7d78-4149-a670-710487e3d75c req-4fe09a47-5810-493a-8b5f-ad28b0965653 service nova] Acquiring lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4fb81dfc-7d78-4149-a670-710487e3d75c req-4fe09a47-5810-493a-8b5f-ad28b0965653 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4fb81dfc-7d78-4149-a670-710487e3d75c req-4fe09a47-5810-493a-8b5f-ad28b0965653 service nova] Lock "93e11e7a-7de2-4783-a789-c2640267ce16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-4fb81dfc-7d78-4149-a670-710487e3d75c req-4fe09a47-5810-493a-8b5f-ad28b0965653 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] No waiting events found dispatching network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:08:01 user nova-compute[73029]: WARNING nova.compute.manager [req-4fb81dfc-7d78-4149-a670-710487e3d75c req-4fe09a47-5810-493a-8b5f-ad28b0965653 service nova] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Received unexpected event network-vif-plugged-5d0a86c1-b2a2-467c-a171-e02d5a5907fe for instance with vm_state deleted and task_state None.
Aug 10 01:08:01 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:08:01 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:08:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:01 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Deleted allocations for instance 93e11e7a-7de2-4783-a789-c2640267ce16
Aug 10 01:08:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9e4eae98-6090-49b3-bc58-67037f715da7 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "93e11e7a-7de2-4783-a789-c2640267ce16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.832s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:08:14 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629679.7121277, 93e11e7a-7de2-4783-a789-c2640267ce16 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:08:14 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] VM Stopped (Lifecycle Event)
Aug 10 01:08:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-877211dc-586b-43fa-894e-a5e1a5af5222 None None] [instance: 93e11e7a-7de2-4783-a789-c2640267ce16] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:08:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:08:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:08:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:08:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:08:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:08:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:08:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:08:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:08:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:08:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:08:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:08:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:35 user nova-compute[73029]: INFO nova.compute.manager [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Detaching volume 3bf07bd8-5f36-4bed-84bc-9e93af5268c9
Aug 10 01:08:35 user nova-compute[73029]: INFO nova.virt.block_device [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Attempting to driver detach volume 3bf07bd8-5f36-4bed-84bc-9e93af5268c9 from mountpoint /dev/vdc
Aug 10 01:08:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Attempting to detach device vdc from instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:08:35 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:08:35 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 01:08:35 user nova-compute[73029]:   <target dev="vdc" bus="virtio"/>
Aug 10 01:08:35 user nova-compute[73029]:   <serial>3bf07bd8-5f36-4bed-84bc-9e93af5268c9</serial>
Aug 10 01:08:35 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 10 01:08:35 user nova-compute[73029]: </disk>
Aug 10 01:08:35 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:08:35 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully detached device vdc from instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 from the persistent domain config.
Aug 10 01:08:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:08:35 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:08:35 user nova-compute[73029]:   <source dev="/dev/sdd"/>
Aug 10 01:08:35 user nova-compute[73029]:   <target dev="vdc" bus="virtio"/>
Aug 10 01:08:35 user nova-compute[73029]:   <serial>3bf07bd8-5f36-4bed-84bc-9e93af5268c9</serial>
Aug 10 01:08:35 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 10 01:08:35 user nova-compute[73029]: </disk>
Aug 10 01:08:35 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691629715.9745512, 453a13a0-f725-4bc0-9ff2-c8dee38cad41 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:08:35 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully detached device vdc from instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 from the live domain config.
Aug 10 01:08:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXodlEkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:08:35 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:08:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:08:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5e7652-0e50-4266-94fa-0a38f9468299]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee052e05-c54b-4354-911f-15eea607114f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:08:36 user nova-compute[73029]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 (non-flash)
Aug 10 01:08:36 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:08:36 user nova-compute[73029]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 (non-flash)
Aug 10 01:08:36 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75264f7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9'): ({'sdd'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Removing single pathed devices sdd {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afba9da-2901-4e38-957a-644a3bb277b4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f4e67a-a69b-4d6e-a17d-de95edaa5ace]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Flushing IO for device /dev/sdd {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1886e9f9-3c51-48a3-9d48-0f223ca20b50]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac521b45-a3ad-497a-add1-2d8c5b988123]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd388f-6557-403f-b572-d3ab80632d13]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f68677a-bbcd-410a-9339-62d6c345fe7c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9, portal: 172.16.0.220,3260]
Aug 10 01:08:36 user nova-compute[73029]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9, portal: 172.16.0.220,3260] successful.
Aug 10 01:08:36 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf07bd8-5f36-4bed-84bc-9e93af5268c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a5f997-cc55-49ab-a343-3f03077dd7fe]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] <== disconnect_volume: return (264ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:08:36 user nova-compute[73029]: DEBUG nova.objects.instance [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'flavor' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:08:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-80657ddb-ccdc-490a-bc66-23511dfa6fad tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.573s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:08:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:40 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:08:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:08:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:08:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:08:43 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:08:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:08:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:08:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:08:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:08:49 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:08:49 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=24.928455352783203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance eb392795-1e14-4753-b0e3-0971ab34e369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "eb392795-1e14-4753-b0e3-0971ab34e369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "eb392795-1e14-4753-b0e3-0971ab34e369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:49 user nova-compute[73029]: INFO nova.compute.manager [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Terminating instance
Aug 10 01:08:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-1ab59e92-e6c5-4523-81fe-999c9e810bee req-aff9e09b-cb4b-4fda-b4a8-37e55d46e6a0 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received event network-vif-unplugged-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1ab59e92-e6c5-4523-81fe-999c9e810bee req-aff9e09b-cb4b-4fda-b4a8-37e55d46e6a0 service nova] Acquiring lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1ab59e92-e6c5-4523-81fe-999c9e810bee req-aff9e09b-cb4b-4fda-b4a8-37e55d46e6a0 service nova] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1ab59e92-e6c5-4523-81fe-999c9e810bee req-aff9e09b-cb4b-4fda-b4a8-37e55d46e6a0 service nova] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-1ab59e92-e6c5-4523-81fe-999c9e810bee req-aff9e09b-cb4b-4fda-b4a8-37e55d46e6a0 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] No waiting events found dispatching network-vif-unplugged-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-1ab59e92-e6c5-4523-81fe-999c9e810bee req-aff9e09b-cb4b-4fda-b4a8-37e55d46e6a0 service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received event network-vif-unplugged-c4a926df-e2a2-438f-8953-535e20e82e86 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:08:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Instance destroyed successfully.
Aug 10 01:08:50 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'resources' on Instance uuid eb392795-1e14-4753-b0e3-0971ab34e369 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-351865626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-351865626',id=35,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:59:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-fw0ym486',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:01:25Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=eb392795-1e14-4753-b0e3-0971ab34e369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "c4a926df-e2a2-438f-8953-535e20e82e86", "address": "fa:16:3e:58:01:77", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a926df-e2", "ovs_interfaceid": "c4a926df-e2a2-438f-8953-535e20e82e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:01:77,bridge_name='br-int',has_traffic_filtering=True,id=c4a926df-e2a2-438f-8953-535e20e82e86,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a926df-e2') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG os_vif [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:01:77,bridge_name='br-int',has_traffic_filtering=True,id=c4a926df-e2a2-438f-8953-535e20e82e86,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a926df-e2') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4a926df-e2, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:08:50 user nova-compute[73029]: INFO os_vif [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:01:77,bridge_name='br-int',has_traffic_filtering=True,id=c4a926df-e2a2-438f-8953-535e20e82e86,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a926df-e2')
Aug 10 01:08:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Deleting instance files /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369_del
Aug 10 01:08:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Deletion of /opt/stack/data/nova/instances/eb392795-1e14-4753-b0e3-0971ab34e369_del complete
Aug 10 01:08:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:08:50 user nova-compute[73029]: INFO nova.compute.manager [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 10 01:08:50 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:08:50 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:08:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:08:51 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:08:51 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Took 0.52 seconds to deallocate network for instance.
Aug 10 01:08:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-9716b69b-4389-4021-919c-d9ca558b2399 req-77942269-ddc4-4a11-ae95-79eedd439e5f service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received event network-vif-deleted-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:08:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:51 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:08:51 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:08:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:51 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Deleted allocations for instance eb392795-1e14-4753-b0e3-0971ab34e369
Aug 10 01:08:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a187d742-ff5a-4112-b688-0713da510563 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "eb392795-1e14-4753-b0e3-0971ab34e369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-e00de56c-2ef6-41e1-9f5c-af776489be59 req-c1cfb52e-2e4a-4a38-ae06-9724b4ba085e service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received event network-vif-plugged-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:08:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e00de56c-2ef6-41e1-9f5c-af776489be59 req-c1cfb52e-2e4a-4a38-ae06-9724b4ba085e service nova] Acquiring lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:08:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e00de56c-2ef6-41e1-9f5c-af776489be59 req-c1cfb52e-2e4a-4a38-ae06-9724b4ba085e service nova] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:08:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e00de56c-2ef6-41e1-9f5c-af776489be59 req-c1cfb52e-2e4a-4a38-ae06-9724b4ba085e service nova] Lock "eb392795-1e14-4753-b0e3-0971ab34e369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:08:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-e00de56c-2ef6-41e1-9f5c-af776489be59 req-c1cfb52e-2e4a-4a38-ae06-9724b4ba085e service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] No waiting events found dispatching network-vif-plugged-c4a926df-e2a2-438f-8953-535e20e82e86 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:08:52 user nova-compute[73029]: WARNING nova.compute.manager [req-e00de56c-2ef6-41e1-9f5c-af776489be59 req-c1cfb52e-2e4a-4a38-ae06-9724b4ba085e service nova] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Received unexpected event network-vif-plugged-c4a926df-e2a2-438f-8953-535e20e82e86 for instance with vm_state deleted and task_state None.
Aug 10 01:08:55 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:08:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:09:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:09:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:09:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:09:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:05 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629730.6205547, eb392795-1e14-4753-b0e3-0971ab34e369 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:09:05 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] VM Stopped (Lifecycle Event)
Aug 10 01:09:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-df962afb-1c58-4907-9906-7e942bdb7506 None None] [instance: eb392795-1e14-4753-b0e3-0971ab34e369] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:09:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:09:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:09:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:25 user nova-compute[73029]: INFO nova.compute.manager [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Terminating instance
Aug 10 01:09:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-06953c32-f191-431e-b94a-7b05046b9c3d req-4948b2a8-829a-4fa1-91dc-5b44f9ef8b82 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-unplugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-06953c32-f191-431e-b94a-7b05046b9c3d req-4948b2a8-829a-4fa1-91dc-5b44f9ef8b82 service nova] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-06953c32-f191-431e-b94a-7b05046b9c3d req-4948b2a8-829a-4fa1-91dc-5b44f9ef8b82 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-06953c32-f191-431e-b94a-7b05046b9c3d req-4948b2a8-829a-4fa1-91dc-5b44f9ef8b82 service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-06953c32-f191-431e-b94a-7b05046b9c3d req-4948b2a8-829a-4fa1-91dc-5b44f9ef8b82 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] No waiting events found dispatching network-vif-unplugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-06953c32-f191-431e-b94a-7b05046b9c3d req-4948b2a8-829a-4fa1-91dc-5b44f9ef8b82 service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-unplugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:09:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Instance destroyed successfully.
Aug 10 01:09:26 user nova-compute[73029]: DEBUG nova.objects.instance [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'resources' on Instance uuid 453a13a0-f725-4bc0-9ff2-c8dee38cad41 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T01:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1833026875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1833026875',id=37,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEGdNiwx5QbPl7vlPccwSGe70dJI33VDMaLMH86viCzaIqe6Ww1es4Ta9D5hunhHT8FNMAbuCzsJpwkfMgC93tfQOL7K/UqLwCidUygGmNMdkDso7AY0IPTVmNeEvSzLw==',key_name='tempest-keypair-1337121988',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:07:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-50czkq8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:07:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=453a13a0-f725-4bc0-9ff2-c8dee38cad41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "address": "fa:16:3e:29:44:d2", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6bfbc9-b8", "ovs_interfaceid": "1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG os_vif [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f6bfbc9-b8, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:09:26 user nova-compute[73029]: INFO os_vif [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:44:d2,bridge_name='br-int',has_traffic_filtering=True,id=1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6bfbc9-b8')
Aug 10 01:09:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Deleting instance files /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41_del
Aug 10 01:09:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Deletion of /opt/stack/data/nova/instances/453a13a0-f725-4bc0-9ff2-c8dee38cad41_del complete
Aug 10 01:09:26 user nova-compute[73029]: INFO nova.compute.manager [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 10 01:09:26 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:09:26 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:09:27 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:09:27 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Took 0.79 seconds to deallocate network for instance.
Aug 10 01:09:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:27 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:09:27 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:09:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:27 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Deleted allocations for instance 453a13a0-f725-4bc0-9ff2-c8dee38cad41
Aug 10 01:09:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3c8a2950-fdf9-4f3e-bdf7-8ea04181b653 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.938s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-65571e1d-54c1-4f5e-a618-ed2b973cb19c req-a955cb16-bc92-40a9-b607-1d8257db4cfe service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:09:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-65571e1d-54c1-4f5e-a618-ed2b973cb19c req-a955cb16-bc92-40a9-b607-1d8257db4cfe service nova] Acquiring lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-65571e1d-54c1-4f5e-a618-ed2b973cb19c req-a955cb16-bc92-40a9-b607-1d8257db4cfe service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-65571e1d-54c1-4f5e-a618-ed2b973cb19c req-a955cb16-bc92-40a9-b607-1d8257db4cfe service nova] Lock "453a13a0-f725-4bc0-9ff2-c8dee38cad41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-65571e1d-54c1-4f5e-a618-ed2b973cb19c req-a955cb16-bc92-40a9-b607-1d8257db4cfe service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] No waiting events found dispatching network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:09:28 user nova-compute[73029]: WARNING nova.compute.manager [req-65571e1d-54c1-4f5e-a618-ed2b973cb19c req-a955cb16-bc92-40a9-b607-1d8257db4cfe service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received unexpected event network-vif-plugged-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf for instance with vm_state deleted and task_state None.
Aug 10 01:09:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-65571e1d-54c1-4f5e-a618-ed2b973cb19c req-a955cb16-bc92-40a9-b607-1d8257db4cfe service nova] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Received event network-vif-deleted-1f6bfbc9-b8e9-45ad-bcbc-abee10e51acf {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:09:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:38 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:40 user nova-compute[73029]: INFO nova.compute.manager [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Terminating instance
Aug 10 01:09:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-d17ed6b4-5e78-45f5-98ca-b527c8e49256 req-e5de7c38-8f09-41b2-9755-60cf2b9897b0 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-unplugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d17ed6b4-5e78-45f5-98ca-b527c8e49256 req-e5de7c38-8f09-41b2-9755-60cf2b9897b0 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d17ed6b4-5e78-45f5-98ca-b527c8e49256 req-e5de7c38-8f09-41b2-9755-60cf2b9897b0 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d17ed6b4-5e78-45f5-98ca-b527c8e49256 req-e5de7c38-8f09-41b2-9755-60cf2b9897b0 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-d17ed6b4-5e78-45f5-98ca-b527c8e49256 req-e5de7c38-8f09-41b2-9755-60cf2b9897b0 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-unplugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG nova.compute.manager [req-d17ed6b4-5e78-45f5-98ca-b527c8e49256 req-e5de7c38-8f09-41b2-9755-60cf2b9897b0 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-unplugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Instance destroyed successfully.
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.objects.instance [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'resources' on Instance uuid 3d6ce28c-39f0-432c-bfe3-a5891fb69021 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-831966501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-831966501',id=32,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:55:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-nr8n9cjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:57:41Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=3d6ce28c-39f0-432c-bfe3-a5891fb69021,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "858ac141-686d-4e33-9ee4-f90c5d43e834", "address": "fa:16:3e:d8:cb:18", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap858ac141-68", "ovs_interfaceid": "858ac141-686d-4e33-9ee4-f90c5d43e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:cb:18,bridge_name='br-int',has_traffic_filtering=True,id=858ac141-686d-4e33-9ee4-f90c5d43e834,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap858ac141-68') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_vif [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:cb:18,bridge_name='br-int',has_traffic_filtering=True,id=858ac141-686d-4e33-9ee4-f90c5d43e834,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap858ac141-68') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap858ac141-68, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:09:41 user nova-compute[73029]: INFO os_vif [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:cb:18,bridge_name='br-int',has_traffic_filtering=True,id=858ac141-686d-4e33-9ee4-f90c5d43e834,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap858ac141-68')
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DupvtCwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:09:41 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[936b6288-95cf-4c96-83c4-70e1d159d9fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b1fa3c-c7c6-494e-a6da-1c7e3bbbcd13]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:09:41 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e (non-flash)
Aug 10 01:09:41 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141a40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a04c5b-7f5e-4d46-8514-55a5c7434d53]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eed7f7-990e-441e-b259-2d15ad7f755f]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f031efb-ae1b-47f9-814f-fc6e565c6160]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aef06f9-5a26-4af0-a034-ef36654d0385]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[881314e6-67eb-464b-b1a4-3124413a6c2a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[87445648-93a8-4d09-9d81-48bc80fbeec9]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e, portal: 172.16.0.220,3260]
Aug 10 01:09:41 user nova-compute[73029]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e, portal: 172.16.0.220,3260] successful.
Aug 10 01:09:41 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b657d186-0636-4d90-a0f4-a03cc37eb04e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a91bdc0-7b8d-464c-9cac-22a775b4f40c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.240s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] <== disconnect_volume: return (241ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:09:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Deleting instance files /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021_del
Aug 10 01:09:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Deletion of /opt/stack/data/nova/instances/3d6ce28c-39f0-432c-bfe3-a5891fb69021_del complete
Aug 10 01:09:41 user nova-compute[73029]: INFO nova.compute.manager [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 10 01:09:41 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629766.5413315, 453a13a0-f725-4bc0-9ff2-c8dee38cad41 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:09:41 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] VM Stopped (Lifecycle Event)
Aug 10 01:09:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e3ed7294-e5c7-4661-bbcf-6ab64bc1acda None None] [instance: 453a13a0-f725-4bc0-9ff2-c8dee38cad41] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Skipping network cache update for instance because it is being deleted. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 1c23f226-a16a-4158-bac9-b9d78381fb5c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:09:42 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Took 0.79 seconds to deallocate network for instance.
Aug 10 01:09:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-dd977cc9-6160-4841-b836-e1e50c99feeb req-0ca0511d-2447-4584-b57d-fab6272184c8 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-deleted-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-7cb55c6d-5bc3-41ae-8302-24e746f18402 req-99150930-907d-4efc-8d20-37c4b2930756 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7cb55c6d-5bc3-41ae-8302-24e746f18402 req-99150930-907d-4efc-8d20-37c4b2930756 service nova] Acquiring lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7cb55c6d-5bc3-41ae-8302-24e746f18402 req-99150930-907d-4efc-8d20-37c4b2930756 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7cb55c6d-5bc3-41ae-8302-24e746f18402 req-99150930-907d-4efc-8d20-37c4b2930756 service nova] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-7cb55c6d-5bc3-41ae-8302-24e746f18402 req-99150930-907d-4efc-8d20-37c4b2930756 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] No waiting events found dispatching network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:09:42 user nova-compute[73029]: WARNING nova.compute.manager [req-7cb55c6d-5bc3-41ae-8302-24e746f18402 req-99150930-907d-4efc-8d20-37c4b2930756 service nova] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Received unexpected event network-vif-plugged-858ac141-686d-4e33-9ee4-f90c5d43e834 for instance with vm_state active and task_state deleting.
Aug 10 01:09:43 user nova-compute[73029]: INFO nova.compute.manager [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Took 0.78 seconds to detach 1 volumes for instance.
Aug 10 01:09:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:43 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updating instance_info_cache with network_info: [{"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:09:43 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:09:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-1c23f226-a16a-4158-bac9-b9d78381fb5c" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:09:43 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:09:43 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:09:43 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:43 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Deleted allocations for instance 3d6ce28c-39f0-432c-bfe3-a5891fb69021
Aug 10 01:09:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-92009b21-0a19-4a06-a373-7a737610dd84 tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "3d6ce28c-39f0-432c-bfe3-a5891fb69021" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.007s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:45 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:09:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:09:49 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:09:49 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:09:49 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=25.080760955810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:09:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:09:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:09:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:09:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:09:50 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:09:50 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:09:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:09:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:09:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:09:55 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:09:56 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629781.15208, 3d6ce28c-39f0-432c-bfe3-a5891fb69021 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:09:56 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] VM Stopped (Lifecycle Event)
Aug 10 01:09:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4e4b81c6-c3b5-4e8e-a339-36aaff05c6d7 None None] [instance: 3d6ce28c-39f0-432c-bfe3-a5891fb69021] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:09:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:10:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:10:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:10:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:10:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:10:19 user nova-compute[73029]: INFO nova.compute.claims [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Claim successful on node user
Aug 10 01:10:19 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:10:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:10:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:10:19 user nova-compute[73029]: DEBUG nova.policy [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45605bba94154ec797f1be53cd778876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed8b4d1eded488da4e1dc7c699bf32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:10:20 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Creating image(s)
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk 1073741824" returned: 0 in 0.051s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Cannot resize image /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG nova.objects.instance [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'migration_context' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Successfully created port: 60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Ensure instance console log exists: /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Successfully updated port: 60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-1a33808a-7130-48d4-bab2-3cacc8aef632 req-c54b23e1-e19f-4355-b41b-5889b0e79eff service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-changed-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-1a33808a-7130-48d4-bab2-3cacc8aef632 req-c54b23e1-e19f-4355-b41b-5889b0e79eff service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Refreshing instance network info cache due to event network-changed-60f22e9b-b386-4ee8-9309-8377b000884e. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1a33808a-7130-48d4-bab2-3cacc8aef632 req-c54b23e1-e19f-4355-b41b-5889b0e79eff service nova] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.network.neutron [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance network_info: |[{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1a33808a-7130-48d4-bab2-3cacc8aef632 req-c54b23e1-e19f-4355-b41b-5889b0e79eff service nova] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-1a33808a-7130-48d4-bab2-3cacc8aef632 req-c54b23e1-e19f-4355-b41b-5889b0e79eff service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Refreshing network info cache for port 60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Start _get_guest_xml network_info=[{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:10:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:10:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1044431689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1044431689',id=38,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqF4kgiKJ2Kqry4+GrFE3F81X4Q0b2bdkt3oou82AyCK29olxhUFKM8V1WLwz6rvRMJsyMp4Uqj7R8/HlKgVAmUEe8SbzK30gxT/epVueftJ2XaNxWimGsqzduwpnsDpA==',key_name='tempest-keypair-581583587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-1eby2eds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:10:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=3a028430-195c-46aa-b49d-edc268f0af8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:10:21 user nova-compute[73029]:   <uuid>3a028430-195c-46aa-b49d-edc268f0af8d</uuid>
Aug 10 01:10:21 user nova-compute[73029]:   <name>instance-00000026</name>
Aug 10 01:10:21 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:10:21 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:10:21 user nova-compute[73029]:   <metadata>
Aug 10 01:10:21 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:10:21 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:10:21 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1044431689</nova:name>
Aug 10 01:10:21 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:10:21</nova:creationTime>
Aug 10 01:10:21 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:10:21 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:10:21 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:10:21 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:10:21 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:10:21 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:10:21 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:10:21 user nova-compute[73029]:       <nova:owner>
Aug 10 01:10:21 user nova-compute[73029]:         <nova:user uuid="45605bba94154ec797f1be53cd778876">tempest-AttachVolumeShelveTestJSON-2077435926-project-member</nova:user>
Aug 10 01:10:21 user nova-compute[73029]:         <nova:project uuid="6ed8b4d1eded488da4e1dc7c699bf32b">tempest-AttachVolumeShelveTestJSON-2077435926</nova:project>
Aug 10 01:10:21 user nova-compute[73029]:       </nova:owner>
Aug 10 01:10:21 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:10:21 user nova-compute[73029]:       <nova:ports>
Aug 10 01:10:21 user nova-compute[73029]:         <nova:port uuid="60f22e9b-b386-4ee8-9309-8377b000884e">
Aug 10 01:10:21 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 01:10:21 user nova-compute[73029]:         </nova:port>
Aug 10 01:10:21 user nova-compute[73029]:       </nova:ports>
Aug 10 01:10:21 user nova-compute[73029]:     </nova:instance>
Aug 10 01:10:21 user nova-compute[73029]:   </metadata>
Aug 10 01:10:21 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:10:21 user nova-compute[73029]:     <system>
Aug 10 01:10:21 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:10:21 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:10:21 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:10:21 user nova-compute[73029]:       <entry name="serial">3a028430-195c-46aa-b49d-edc268f0af8d</entry>
Aug 10 01:10:21 user nova-compute[73029]:       <entry name="uuid">3a028430-195c-46aa-b49d-edc268f0af8d</entry>
Aug 10 01:10:21 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:10:21 user nova-compute[73029]:     </system>
Aug 10 01:10:21 user nova-compute[73029]:   </sysinfo>
Aug 10 01:10:21 user nova-compute[73029]:   <os>
Aug 10 01:10:21 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:10:21 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:10:21 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:10:21 user nova-compute[73029]:   </os>
Aug 10 01:10:21 user nova-compute[73029]:   <features>
Aug 10 01:10:21 user nova-compute[73029]:     <acpi/>
Aug 10 01:10:21 user nova-compute[73029]:     <apic/>
Aug 10 01:10:21 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:10:21 user nova-compute[73029]:   </features>
Aug 10 01:10:21 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:10:21 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:10:21 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:10:21 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:10:21 user nova-compute[73029]:   </clock>
Aug 10 01:10:21 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:10:21 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:10:21 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:10:21 user nova-compute[73029]:   </cpu>
Aug 10 01:10:21 user nova-compute[73029]:   <devices>
Aug 10 01:10:21 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:10:21 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:10:21 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk"/>
Aug 10 01:10:21 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:10:21 user nova-compute[73029]:     </disk>
Aug 10 01:10:21 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:10:21 user nova-compute[73029]:       <mac address="fa:16:3e:f6:cf:4b"/>
Aug 10 01:10:21 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:10:21 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:10:21 user nova-compute[73029]:       <target dev="tap60f22e9b-b3"/>
Aug 10 01:10:21 user nova-compute[73029]:     </interface>
Aug 10 01:10:21 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:10:21 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/console.log" append="off"/>
Aug 10 01:10:21 user nova-compute[73029]:     </serial>
Aug 10 01:10:21 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:10:21 user nova-compute[73029]:     <video>
Aug 10 01:10:21 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:10:21 user nova-compute[73029]:     </video>
Aug 10 01:10:21 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:10:21 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:10:21 user nova-compute[73029]:     </rng>
Aug 10 01:10:21 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:10:21 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:10:21 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:10:21 user nova-compute[73029]:     </memballoon>
Aug 10 01:10:21 user nova-compute[73029]:   </devices>
Aug 10 01:10:21 user nova-compute[73029]: </domain>
Aug 10 01:10:21 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1044431689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1044431689',id=38,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqF4kgiKJ2Kqry4+GrFE3F81X4Q0b2bdkt3oou82AyCK29olxhUFKM8V1WLwz6rvRMJsyMp4Uqj7R8/HlKgVAmUEe8SbzK30gxT/epVueftJ2XaNxWimGsqzduwpnsDpA==',key_name='tempest-keypair-581583587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-1eby2eds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:10:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=3a028430-195c-46aa-b49d-edc268f0af8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG os_vif [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f22e9b-b3, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60f22e9b-b3, col_values=(('external_ids', {'iface-id': '60f22e9b-b386-4ee8-9309-8377b000884e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:cf:4b', 'vm-uuid': '3a028430-195c-46aa-b49d-edc268f0af8d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:21 user nova-compute[73029]: INFO os_vif [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3')
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:10:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] No VIF found with MAC fa:16:3e:f6:cf:4b, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:10:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-1a33808a-7130-48d4-bab2-3cacc8aef632 req-c54b23e1-e19f-4355-b41b-5889b0e79eff service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updated VIF entry in instance network info cache for port 60f22e9b-b386-4ee8-9309-8377b000884e. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:10:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-1a33808a-7130-48d4-bab2-3cacc8aef632 req-c54b23e1-e19f-4355-b41b-5889b0e79eff service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:10:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1a33808a-7130-48d4-bab2-3cacc8aef632 req-c54b23e1-e19f-4355-b41b-5889b0e79eff service nova] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-550fb780-c81e-4ceb-9f68-33c035dab08a req-b7b59e97-3658-4915-aa58-7d22f4667975 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-550fb780-c81e-4ceb-9f68-33c035dab08a req-b7b59e97-3658-4915-aa58-7d22f4667975 service nova] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-550fb780-c81e-4ceb-9f68-33c035dab08a req-b7b59e97-3658-4915-aa58-7d22f4667975 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-550fb780-c81e-4ceb-9f68-33c035dab08a req-b7b59e97-3658-4915-aa58-7d22f4667975 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-550fb780-c81e-4ceb-9f68-33c035dab08a req-b7b59e97-3658-4915-aa58-7d22f4667975 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] No waiting events found dispatching network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:10:23 user nova-compute[73029]: WARNING nova.compute.manager [req-550fb780-c81e-4ceb-9f68-33c035dab08a req-b7b59e97-3658-4915-aa58-7d22f4667975 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received unexpected event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e for instance with vm_state building and task_state spawning.
Aug 10 01:10:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629825.2250512, 3a028430-195c-46aa-b49d-edc268f0af8d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:10:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] VM Resumed (Lifecycle Event)
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:10:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance spawned successfully.
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:10:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629825.2290998, 3a028430-195c-46aa-b49d-edc268f0af8d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:10:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] VM Started (Lifecycle Event)
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:10:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:10:25 user nova-compute[73029]: INFO nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:10:25 user nova-compute[73029]: INFO nova.compute.manager [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Took 5.87 seconds to build instance.
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-1036826c-8ac9-435f-9c3a-223da1ddda0e req-82e74b8a-931f-4e69-8c04-79e9e4c1d167 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1036826c-8ac9-435f-9c3a-223da1ddda0e req-82e74b8a-931f-4e69-8c04-79e9e4c1d167 service nova] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1036826c-8ac9-435f-9c3a-223da1ddda0e req-82e74b8a-931f-4e69-8c04-79e9e4c1d167 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1036826c-8ac9-435f-9c3a-223da1ddda0e req-82e74b8a-931f-4e69-8c04-79e9e4c1d167 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-1036826c-8ac9-435f-9c3a-223da1ddda0e req-82e74b8a-931f-4e69-8c04-79e9e4c1d167 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] No waiting events found dispatching network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:10:25 user nova-compute[73029]: WARNING nova.compute.manager [req-1036826c-8ac9-435f-9c3a-223da1ddda0e req-82e74b8a-931f-4e69-8c04-79e9e4c1d167 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received unexpected event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e for instance with vm_state active and task_state None.
Aug 10 01:10:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-121295f4-3040-44d8-b627-4596e1a2a375 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.976s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:31 user nova-compute[73029]: INFO nova.compute.manager [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Terminating instance
Aug 10 01:10:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-9074c7aa-ca76-4952-b13d-81612fff9e6a req-58129c90-8930-4369-ba83-262d7698c879 service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received event network-vif-unplugged-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9074c7aa-ca76-4952-b13d-81612fff9e6a req-58129c90-8930-4369-ba83-262d7698c879 service nova] Acquiring lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9074c7aa-ca76-4952-b13d-81612fff9e6a req-58129c90-8930-4369-ba83-262d7698c879 service nova] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-9074c7aa-ca76-4952-b13d-81612fff9e6a req-58129c90-8930-4369-ba83-262d7698c879 service nova] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-9074c7aa-ca76-4952-b13d-81612fff9e6a req-58129c90-8930-4369-ba83-262d7698c879 service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] No waiting events found dispatching network-vif-unplugged-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-9074c7aa-ca76-4952-b13d-81612fff9e6a req-58129c90-8930-4369-ba83-262d7698c879 service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received event network-vif-unplugged-5433e300-24ad-4db0-99ee-b477443a14ff for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Instance destroyed successfully.
Aug 10 01:10:31 user nova-compute[73029]: DEBUG nova.objects.instance [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lazy-loading 'resources' on Instance uuid 1c23f226-a16a-4158-bac9-b9d78381fb5c {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T00:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-200828680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-200828680',id=29,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T00:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39027fdade2f41048db7d3855f3197cc',ramdisk_id='',reservation_id='r-hpoxeefp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T00:52:53Z,user_data=None,user_id='6d34a91746034f349b7eeccfd372f21a',uuid=1c23f226-a16a-4158-bac9-b9d78381fb5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converting VIF {"id": "5433e300-24ad-4db0-99ee-b477443a14ff", "address": "fa:16:3e:bd:3f:a0", "network": {"id": "3523f1c4-b491-47c3-94df-e56eea4d2348", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-188844711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39027fdade2f41048db7d3855f3197cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5433e300-24", "ovs_interfaceid": "5433e300-24ad-4db0-99ee-b477443a14ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:3f:a0,bridge_name='br-int',has_traffic_filtering=True,id=5433e300-24ad-4db0-99ee-b477443a14ff,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5433e300-24') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG os_vif [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:3f:a0,bridge_name='br-int',has_traffic_filtering=True,id=5433e300-24ad-4db0-99ee-b477443a14ff,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5433e300-24') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5433e300-24, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:10:31 user nova-compute[73029]: INFO os_vif [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:3f:a0,bridge_name='br-int',has_traffic_filtering=True,id=5433e300-24ad-4db0-99ee-b477443a14ff,network=Network(3523f1c4-b491-47c3-94df-e56eea4d2348),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5433e300-24')
Aug 10 01:10:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Deleting instance files /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c_del
Aug 10 01:10:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Deletion of /opt/stack/data/nova/instances/1c23f226-a16a-4158-bac9-b9d78381fb5c_del complete
Aug 10 01:10:32 user nova-compute[73029]: INFO nova.compute.manager [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 10 01:10:32 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:10:32 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:10:32 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:10:32 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:10:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-7138e56f-508e-4f10-b930-f746d93295cd req-fc1c3b33-895a-41a7-975e-90e6ef01521d service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received event network-vif-deleted-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:10:32 user nova-compute[73029]: INFO nova.compute.manager [req-7138e56f-508e-4f10-b930-f746d93295cd req-fc1c3b33-895a-41a7-975e-90e6ef01521d service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Neutron deleted interface 5433e300-24ad-4db0-99ee-b477443a14ff; detaching it from the instance and deleting it from the info cache
Aug 10 01:10:32 user nova-compute[73029]: DEBUG nova.network.neutron [req-7138e56f-508e-4f10-b930-f746d93295cd req-fc1c3b33-895a-41a7-975e-90e6ef01521d service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:10:32 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Took 0.45 seconds to deallocate network for instance.
Aug 10 01:10:32 user nova-compute[73029]: DEBUG nova.compute.manager [req-7138e56f-508e-4f10-b930-f746d93295cd req-fc1c3b33-895a-41a7-975e-90e6ef01521d service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Detach interface failed, port_id=5433e300-24ad-4db0-99ee-b477443a14ff, reason: Instance 1c23f226-a16a-4158-bac9-b9d78381fb5c could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 01:10:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:32 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:10:32 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:10:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:32 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Deleted allocations for instance 1c23f226-a16a-4158-bac9-b9d78381fb5c
Aug 10 01:10:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-cb536035-224e-49ea-92e0-709cfd37163b tempest-ServerBootFromVolumeStableRescueTest-1463443327 tempest-ServerBootFromVolumeStableRescueTest-1463443327-project-member] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.618s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-04af6c3e-120b-4ff3-bd5b-4bfe79963df0 req-497561ce-424a-4731-b40d-08eba0e8fb38 service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received event network-vif-plugged-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:10:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-04af6c3e-120b-4ff3-bd5b-4bfe79963df0 req-497561ce-424a-4731-b40d-08eba0e8fb38 service nova] Acquiring lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-04af6c3e-120b-4ff3-bd5b-4bfe79963df0 req-497561ce-424a-4731-b40d-08eba0e8fb38 service nova] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-04af6c3e-120b-4ff3-bd5b-4bfe79963df0 req-497561ce-424a-4731-b40d-08eba0e8fb38 service nova] Lock "1c23f226-a16a-4158-bac9-b9d78381fb5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-04af6c3e-120b-4ff3-bd5b-4bfe79963df0 req-497561ce-424a-4731-b40d-08eba0e8fb38 service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] No waiting events found dispatching network-vif-plugged-5433e300-24ad-4db0-99ee-b477443a14ff {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:10:33 user nova-compute[73029]: WARNING nova.compute.manager [req-04af6c3e-120b-4ff3-bd5b-4bfe79963df0 req-497561ce-424a-4731-b40d-08eba0e8fb38 service nova] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Received unexpected event network-vif-plugged-5433e300-24ad-4db0-99ee-b477443a14ff for instance with vm_state deleted and task_state None.
Aug 10 01:10:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:10:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:10:43 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:10:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:10:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:10:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:10:46 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629831.9113846, 1c23f226-a16a-4158-bac9-b9d78381fb5c => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:10:46 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] VM Stopped (Lifecycle Event)
Aug 10 01:10:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-76515fa0-4175-4806-98ef-60548532d5f9 None None] [instance: 1c23f226-a16a-4158-bac9-b9d78381fb5c] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:10:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:10:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:10:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:10:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:10:50 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:10:50 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:10:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.176422119140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3a028430-195c-46aa-b49d-edc268f0af8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:10:50 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:10:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:10:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:10:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:10:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:10:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:10:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Verify base images {{(pid=73029) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Image id 48fbc2bc-b0d2-49bf-97dd-ed057d979427 yields fingerprint 095856791146cea2d29c6c3de56a43047bccb6cf {{(pid=73029) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] image 48fbc2bc-b0d2-49bf-97dd-ed057d979427 at (/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf): checking
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] image 48fbc2bc-b0d2-49bf-97dd-ed057d979427 at (/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf): image is in use {{(pid=73029) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73029) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] 3a028430-195c-46aa-b49d-edc268f0af8d is a valid instance name {{(pid=73029) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] 3a028430-195c-46aa-b49d-edc268f0af8d has a disk file {{(pid=73029) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3a028430-195c-46aa-b49d-edc268f0af8d is backed by 095856791146cea2d29c6c3de56a43047bccb6cf {{(pid=73029) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 10 01:11:06 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015
Aug 10 01:11:06 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308
Aug 10 01:11:06 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e
Aug 10 01:11:06 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167
Aug 10 01:11:06 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee
Aug 10 01:11:06 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9
Aug 10 01:11:06 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Active base files: /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Removable base files: /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015 /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308 /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167 /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9 /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9
Aug 10 01:11:06 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Verification complete {{(pid=73029) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Verify swap images {{(pid=73029) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Verify ephemeral images {{(pid=73029) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 10 01:11:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:11:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:11:35 user nova-compute[73029]: INFO nova.compute.claims [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Claim successful on node user
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.network.neutron [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:11:35 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:11:35 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Creating image(s)
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "/opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "/opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "/opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.policy [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ab867cd18c4fbfb8c38f2d4666be8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27575d6efb9a45b2b9b38f2bbed286ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk 1073741824" returned: 0 in 0.050s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:11:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Cannot resize image /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG nova.objects.instance [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'migration_context' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Successfully created port: a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Ensure instance console log exists: /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Successfully updated port: a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-d5446b76-0768-452f-b345-7e197a5400f4 req-81deb9e4-929c-4896-93d4-549ef7d06c99 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-changed-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-d5446b76-0768-452f-b345-7e197a5400f4 req-81deb9e4-929c-4896-93d4-549ef7d06c99 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Refreshing instance network info cache due to event network-changed-a802fdef-f355-4ad7-8d8c-8bc5982152fa. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d5446b76-0768-452f-b345-7e197a5400f4 req-81deb9e4-929c-4896-93d4-549ef7d06c99 service nova] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance network_info: |[{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d5446b76-0768-452f-b345-7e197a5400f4 req-81deb9e4-929c-4896-93d4-549ef7d06c99 service nova] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.neutron [req-d5446b76-0768-452f-b345-7e197a5400f4 req-81deb9e4-929c-4896-93d4-549ef7d06c99 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Refreshing network info cache for port a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Start _get_guest_xml network_info=[{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:11:37 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:11:37 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776952036',display_name='tempest-AttachVolumeTestJSON-server-776952036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776952036',id=39,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAKK0VG3VaK5fUTIrsIMgv2KdcKIveiKEuYPJ3NPT6NMJIrLKchH0nOOACYfezLlyV+Jwy2xpwEI2ExcJ8Dbxy7zTcu6IqOZv7ilbVXlr1d2IPY0JmgEfup+rNLgIEoxA==',key_name='tempest-keypair-986600418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-3wyvwgei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=b674e3df-c413-4306-b3cf-8f872abee7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.objects.instance [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'pci_devices' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:11:37 user nova-compute[73029]:   <uuid>b674e3df-c413-4306-b3cf-8f872abee7fe</uuid>
Aug 10 01:11:37 user nova-compute[73029]:   <name>instance-00000027</name>
Aug 10 01:11:37 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:11:37 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:11:37 user nova-compute[73029]:   <metadata>
Aug 10 01:11:37 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:11:37 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:11:37 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeTestJSON-server-776952036</nova:name>
Aug 10 01:11:37 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:11:37</nova:creationTime>
Aug 10 01:11:37 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:11:37 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:11:37 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:11:37 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:11:37 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:11:37 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:11:37 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:11:37 user nova-compute[73029]:       <nova:owner>
Aug 10 01:11:37 user nova-compute[73029]:         <nova:user uuid="b8ab867cd18c4fbfb8c38f2d4666be8e">tempest-AttachVolumeTestJSON-1442739203-project-member</nova:user>
Aug 10 01:11:37 user nova-compute[73029]:         <nova:project uuid="27575d6efb9a45b2b9b38f2bbed286ec">tempest-AttachVolumeTestJSON-1442739203</nova:project>
Aug 10 01:11:37 user nova-compute[73029]:       </nova:owner>
Aug 10 01:11:37 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:11:37 user nova-compute[73029]:       <nova:ports>
Aug 10 01:11:37 user nova-compute[73029]:         <nova:port uuid="a802fdef-f355-4ad7-8d8c-8bc5982152fa">
Aug 10 01:11:37 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 01:11:37 user nova-compute[73029]:         </nova:port>
Aug 10 01:11:37 user nova-compute[73029]:       </nova:ports>
Aug 10 01:11:37 user nova-compute[73029]:     </nova:instance>
Aug 10 01:11:37 user nova-compute[73029]:   </metadata>
Aug 10 01:11:37 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:11:37 user nova-compute[73029]:     <system>
Aug 10 01:11:37 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:11:37 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:11:37 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:11:37 user nova-compute[73029]:       <entry name="serial">b674e3df-c413-4306-b3cf-8f872abee7fe</entry>
Aug 10 01:11:37 user nova-compute[73029]:       <entry name="uuid">b674e3df-c413-4306-b3cf-8f872abee7fe</entry>
Aug 10 01:11:37 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:11:37 user nova-compute[73029]:     </system>
Aug 10 01:11:37 user nova-compute[73029]:   </sysinfo>
Aug 10 01:11:37 user nova-compute[73029]:   <os>
Aug 10 01:11:37 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:11:37 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:11:37 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:11:37 user nova-compute[73029]:   </os>
Aug 10 01:11:37 user nova-compute[73029]:   <features>
Aug 10 01:11:37 user nova-compute[73029]:     <acpi/>
Aug 10 01:11:37 user nova-compute[73029]:     <apic/>
Aug 10 01:11:37 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:11:37 user nova-compute[73029]:   </features>
Aug 10 01:11:37 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:11:37 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:11:37 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:11:37 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:11:37 user nova-compute[73029]:   </clock>
Aug 10 01:11:37 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:11:37 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:11:37 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:11:37 user nova-compute[73029]:   </cpu>
Aug 10 01:11:37 user nova-compute[73029]:   <devices>
Aug 10 01:11:37 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:11:37 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:11:37 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk"/>
Aug 10 01:11:37 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:11:37 user nova-compute[73029]:     </disk>
Aug 10 01:11:37 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:11:37 user nova-compute[73029]:       <mac address="fa:16:3e:85:e4:bc"/>
Aug 10 01:11:37 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:11:37 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:11:37 user nova-compute[73029]:       <target dev="tapa802fdef-f3"/>
Aug 10 01:11:37 user nova-compute[73029]:     </interface>
Aug 10 01:11:37 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:11:37 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/console.log" append="off"/>
Aug 10 01:11:37 user nova-compute[73029]:     </serial>
Aug 10 01:11:37 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:11:37 user nova-compute[73029]:     <video>
Aug 10 01:11:37 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:11:37 user nova-compute[73029]:     </video>
Aug 10 01:11:37 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:11:37 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:11:37 user nova-compute[73029]:     </rng>
Aug 10 01:11:37 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:11:37 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:11:37 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:11:37 user nova-compute[73029]:     </memballoon>
Aug 10 01:11:37 user nova-compute[73029]:   </devices>
Aug 10 01:11:37 user nova-compute[73029]: </domain>
Aug 10 01:11:37 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776952036',display_name='tempest-AttachVolumeTestJSON-server-776952036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776952036',id=39,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAKK0VG3VaK5fUTIrsIMgv2KdcKIveiKEuYPJ3NPT6NMJIrLKchH0nOOACYfezLlyV+Jwy2xpwEI2ExcJ8Dbxy7zTcu6IqOZv7ilbVXlr1d2IPY0JmgEfup+rNLgIEoxA==',key_name='tempest-keypair-986600418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-3wyvwgei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=b674e3df-c413-4306-b3cf-8f872abee7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG os_vif [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa802fdef-f3, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa802fdef-f3, col_values=(('external_ids', {'iface-id': 'a802fdef-f355-4ad7-8d8c-8bc5982152fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:e4:bc', 'vm-uuid': 'b674e3df-c413-4306-b3cf-8f872abee7fe'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:37 user nova-compute[73029]: INFO os_vif [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3')
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No VIF found with MAC fa:16:3e:85:e4:bc, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.neutron [req-d5446b76-0768-452f-b345-7e197a5400f4 req-81deb9e4-929c-4896-93d4-549ef7d06c99 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updated VIF entry in instance network info cache for port a802fdef-f355-4ad7-8d8c-8bc5982152fa. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG nova.network.neutron [req-d5446b76-0768-452f-b345-7e197a5400f4 req-81deb9e4-929c-4896-93d4-549ef7d06c99 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:11:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d5446b76-0768-452f-b345-7e197a5400f4 req-81deb9e4-929c-4896-93d4-549ef7d06c99 service nova] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:11:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-a438c845-6aac-4741-b4b3-f1a6b3392960 req-2abb83ca-156b-437b-b7aa-f5ce4ebcfd6d service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:11:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a438c845-6aac-4741-b4b3-f1a6b3392960 req-2abb83ca-156b-437b-b7aa-f5ce4ebcfd6d service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a438c845-6aac-4741-b4b3-f1a6b3392960 req-2abb83ca-156b-437b-b7aa-f5ce4ebcfd6d service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a438c845-6aac-4741-b4b3-f1a6b3392960 req-2abb83ca-156b-437b-b7aa-f5ce4ebcfd6d service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-a438c845-6aac-4741-b4b3-f1a6b3392960 req-2abb83ca-156b-437b-b7aa-f5ce4ebcfd6d service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:11:39 user nova-compute[73029]: WARNING nova.compute.manager [req-a438c845-6aac-4741-b4b3-f1a6b3392960 req-2abb83ca-156b-437b-b7aa-f5ce4ebcfd6d service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state building and task_state spawning.
Aug 10 01:11:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629901.0625336, b674e3df-c413-4306-b3cf-8f872abee7fe => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:11:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] VM Resumed (Lifecycle Event)
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:11:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance spawned successfully.
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:11:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691629901.0664675, b674e3df-c413-4306-b3cf-8f872abee7fe => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:11:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] VM Started (Lifecycle Event)
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:11:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-106c642e-7fe0-40bf-828e-bea7b15869d2 req-d803ae1a-402b-474b-b6bc-861c7c0349c4 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-106c642e-7fe0-40bf-828e-bea7b15869d2 req-d803ae1a-402b-474b-b6bc-861c7c0349c4 service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-106c642e-7fe0-40bf-828e-bea7b15869d2 req-d803ae1a-402b-474b-b6bc-861c7c0349c4 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-106c642e-7fe0-40bf-828e-bea7b15869d2 req-d803ae1a-402b-474b-b6bc-861c7c0349c4 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-106c642e-7fe0-40bf-828e-bea7b15869d2 req-d803ae1a-402b-474b-b6bc-861c7c0349c4 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:11:41 user nova-compute[73029]: WARNING nova.compute.manager [req-106c642e-7fe0-40bf-828e-bea7b15869d2 req-d803ae1a-402b-474b-b6bc-861c7c0349c4 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state building and task_state spawning.
Aug 10 01:11:41 user nova-compute[73029]: INFO nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 10 01:11:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:11:41 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:41 user nova-compute[73029]: INFO nova.compute.manager [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Took 6.22 seconds to build instance.
Aug 10 01:11:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-93526561-9741-47db-88f1-4ef3a40dfa95 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.318s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:11:45 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:49 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:11:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:11:51 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:11:51 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8583MB free_disk=25.1737060546875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3a028430-195c-46aa-b49d-edc268f0af8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:11:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:11:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:11:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:11:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:11:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:11:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-d1ee80a8-c928-44b8-8d13-bbea8c71f4dd req-aad3ef55-cd1d-4769-9b2f-6e1baf99abb0 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-changed-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:12:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-d1ee80a8-c928-44b8-8d13-bbea8c71f4dd req-aad3ef55-cd1d-4769-9b2f-6e1baf99abb0 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Refreshing instance network info cache due to event network-changed-60f22e9b-b386-4ee8-9309-8377b000884e. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:12:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d1ee80a8-c928-44b8-8d13-bbea8c71f4dd req-aad3ef55-cd1d-4769-9b2f-6e1baf99abb0 service nova] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:12:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d1ee80a8-c928-44b8-8d13-bbea8c71f4dd req-aad3ef55-cd1d-4769-9b2f-6e1baf99abb0 service nova] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:12:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-d1ee80a8-c928-44b8-8d13-bbea8c71f4dd req-aad3ef55-cd1d-4769-9b2f-6e1baf99abb0 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Refreshing network info cache for port 60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:12:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-d1ee80a8-c928-44b8-8d13-bbea8c71f4dd req-aad3ef55-cd1d-4769-9b2f-6e1baf99abb0 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updated VIF entry in instance network info cache for port 60f22e9b-b386-4ee8-9309-8377b000884e. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:12:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-d1ee80a8-c928-44b8-8d13-bbea8c71f4dd req-aad3ef55-cd1d-4769-9b2f-6e1baf99abb0 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:12:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d1ee80a8-c928-44b8-8d13-bbea8c71f4dd req-aad3ef55-cd1d-4769-9b2f-6e1baf99abb0 service nova] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:12:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:12:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:12:15 user nova-compute[73029]: INFO nova.compute.manager [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Shelving
Aug 10 01:12:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-5e24d11f-2f83-4c40-8deb-990d5b8ada56 req-8b15526b-5991-41e6-860a-87d6d133e79b service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-unplugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:12:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5e24d11f-2f83-4c40-8deb-990d5b8ada56 req-8b15526b-5991-41e6-860a-87d6d133e79b service nova] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:12:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5e24d11f-2f83-4c40-8deb-990d5b8ada56 req-8b15526b-5991-41e6-860a-87d6d133e79b service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:12:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5e24d11f-2f83-4c40-8deb-990d5b8ada56 req-8b15526b-5991-41e6-860a-87d6d133e79b service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:12:16 user nova-compute[73029]: DEBUG nova.compute.manager [req-5e24d11f-2f83-4c40-8deb-990d5b8ada56 req-8b15526b-5991-41e6-860a-87d6d133e79b service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] No waiting events found dispatching network-vif-unplugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:12:16 user nova-compute[73029]: WARNING nova.compute.manager [req-5e24d11f-2f83-4c40-8deb-990d5b8ada56 req-8b15526b-5991-41e6-860a-87d6d133e79b service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received unexpected event network-vif-unplugged-60f22e9b-b386-4ee8-9309-8377b000884e for instance with vm_state active and task_state shelving.
Aug 10 01:12:16 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance destroyed successfully.
Aug 10 01:12:16 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Beginning cold snapshot process
Aug 10 01:12:17 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 01:12:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk /opt/stack/data/nova/instances/snapshots/tmpow3j3blo/3b56927d9f5a4f12832b27b60e6d88ab {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:12:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk /opt/stack/data/nova/instances/snapshots/tmpow3j3blo/3b56927d9f5a4f12832b27b60e6d88ab" returned: 0 in 0.624s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:12:17 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Snapshot extracted, beginning image upload
Aug 10 01:12:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-fbcc6c29-ce29-473f-944c-739003165aaa req-6a2c4313-98cd-40d1-950d-4f527accdda6 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:12:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fbcc6c29-ce29-473f-944c-739003165aaa req-6a2c4313-98cd-40d1-950d-4f527accdda6 service nova] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:12:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fbcc6c29-ce29-473f-944c-739003165aaa req-6a2c4313-98cd-40d1-950d-4f527accdda6 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:12:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fbcc6c29-ce29-473f-944c-739003165aaa req-6a2c4313-98cd-40d1-950d-4f527accdda6 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:12:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-fbcc6c29-ce29-473f-944c-739003165aaa req-6a2c4313-98cd-40d1-950d-4f527accdda6 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] No waiting events found dispatching network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:12:18 user nova-compute[73029]: WARNING nova.compute.manager [req-fbcc6c29-ce29-473f-944c-739003165aaa req-6a2c4313-98cd-40d1-950d-4f527accdda6 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received unexpected event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e for instance with vm_state active and task_state shelving_image_uploading.
Aug 10 01:12:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Snapshot image upload complete
Aug 10 01:12:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:12:20 user nova-compute[73029]: INFO nova.compute.manager [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Shelve offloading
Aug 10 01:12:20 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance destroyed successfully.
Aug 10 01:12:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:12:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:12:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:12:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:12:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:12:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:12:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance destroyed successfully.
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'resources' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1044431689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1044431689',id=38,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqF4kgiKJ2Kqry4+GrFE3F81X4Q0b2bdkt3oou82AyCK29olxhUFKM8V1WLwz6rvRMJsyMp4Uqj7R8/HlKgVAmUEe8SbzK30gxT/epVueftJ2XaNxWimGsqzduwpnsDpA==',key_name='tempest-keypair-581583587',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:10:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-1eby2eds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member',shelved_at='2023-08-10T01:12:19.973592',shelved_host='user',shelved_image_id='a278419b-246c-4eee-9a4f-acf247966c5b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=3a028430-195c-46aa-b49d-edc268f0af8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG os_vif [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f22e9b-b3, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-c2e6e2ac-2583-4781-a2c9-a43f7ca00a85 req-09514061-2d0a-4525-a7f4-6012974acf35 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-changed-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-c2e6e2ac-2583-4781-a2c9-a43f7ca00a85 req-09514061-2d0a-4525-a7f4-6012974acf35 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Refreshing instance network info cache due to event network-changed-60f22e9b-b386-4ee8-9309-8377b000884e. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2e6e2ac-2583-4781-a2c9-a43f7ca00a85 req-09514061-2d0a-4525-a7f4-6012974acf35 service nova] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2e6e2ac-2583-4781-a2c9-a43f7ca00a85 req-09514061-2d0a-4525-a7f4-6012974acf35 service nova] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2e6e2ac-2583-4781-a2c9-a43f7ca00a85 req-09514061-2d0a-4525-a7f4-6012974acf35 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Refreshing network info cache for port 60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:12:21 user nova-compute[73029]: INFO os_vif [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3')
Aug 10 01:12:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Deleting instance files /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d_del
Aug 10 01:12:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Deletion of /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d_del complete
Aug 10 01:12:21 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Deleted allocations for instance 3a028430-195c-46aa-b49d-edc268f0af8d
Aug 10 01:12:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e8486914-05cf-429f-a005-ba09cd1ec41a tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.566s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2e6e2ac-2583-4781-a2c9-a43f7ca00a85 req-09514061-2d0a-4525-a7f4-6012974acf35 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updated VIF entry in instance network info cache for port 60f22e9b-b386-4ee8-9309-8377b000884e. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2e6e2ac-2583-4781-a2c9-a43f7ca00a85 req-09514061-2d0a-4525-a7f4-6012974acf35 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:12:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2e6e2ac-2583-4781-a2c9-a43f7ca00a85 req-09514061-2d0a-4525-a7f4-6012974acf35 service nova] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:12:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:31 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691629936.7618206, 3a028430-195c-46aa-b49d-edc268f0af8d => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:12:31 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] VM Stopped (Lifecycle Event)
Aug 10 01:12:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0d928fb2-796a-4e52-adb1-ed7d2f6ccb42 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:12:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:12:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:12:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:12:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:12:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:12:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:12:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:12:47 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:12:47 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:12:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:12:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:12:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:12:48 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:12:51 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:12:51 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:12:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.108417510986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:12:51 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:12:52 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:12:52 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:12:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:12:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:12:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:12:57 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:13:04 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 01:13:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:13:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:13:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:13:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:13:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-46b0fa45-f2d7-498e-9939-c917a7b14954 req-7fcdda83-412e-4b18-a332-68844b5a5273 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-changed-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:13:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-46b0fa45-f2d7-498e-9939-c917a7b14954 req-7fcdda83-412e-4b18-a332-68844b5a5273 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Refreshing instance network info cache due to event network-changed-a802fdef-f355-4ad7-8d8c-8bc5982152fa. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:13:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46b0fa45-f2d7-498e-9939-c917a7b14954 req-7fcdda83-412e-4b18-a332-68844b5a5273 service nova] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:13:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46b0fa45-f2d7-498e-9939-c917a7b14954 req-7fcdda83-412e-4b18-a332-68844b5a5273 service nova] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:13:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-46b0fa45-f2d7-498e-9939-c917a7b14954 req-7fcdda83-412e-4b18-a332-68844b5a5273 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Refreshing network info cache for port a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:13:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-46b0fa45-f2d7-498e-9939-c917a7b14954 req-7fcdda83-412e-4b18-a332-68844b5a5273 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updated VIF entry in instance network info cache for port a802fdef-f355-4ad7-8d8c-8bc5982152fa. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:13:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-46b0fa45-f2d7-498e-9939-c917a7b14954 req-7fcdda83-412e-4b18-a332-68844b5a5273 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:13:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-46b0fa45-f2d7-498e-9939-c917a7b14954 req-7fcdda83-412e-4b18-a332-68844b5a5273 service nova] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:13:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:13:30 user nova-compute[73029]: INFO nova.compute.manager [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Attaching volume ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e to /dev/vdb
Aug 10 01:13:30 user nova-compute[73029]: DEBUG os_brick.utils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87190cd-f5f7-4feb-8bf4-194d2a52c955]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7115bf-2d9c-4e70-81e5-4587deb937c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b04f67e-0122-463f-9589-0e6ee67d9639]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bd77e5-4151-46a9-a506-ce573a18dc66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:13:30 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:13:30 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce21d914-70ab-444f-9651-c23e917d8fc0]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG os_brick.utils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:13:30 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating existing volume attachment record: eeb39b63-d7ae-4804-8821-c10dc2fc3030 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:13:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCoJOyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:13:38 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:13:38 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:13:38 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f976de0b-1b7d-425f-879b-20ba9873728e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:13:38 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d02ea1-5052-4fd2-bb98-955697b94ecf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e] added
Aug 10 01:13:38 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9366bc4-603a-4079-be21-e2e5f8398296]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c88270-b960-4ccf-8c84-cce48ca46167]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMCoJOyj {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMCoJOyj" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3148368-0287-4271-97ce-e9ce81ba648b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UMCoJOyj'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b613de59-9f02-4ca5-8507-0e4d3d923769]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d179cfd6-d40d-449a-85f9-18f8aeea5ff2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:13:38 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:13:38 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:13:38 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:13:38 user nova-compute[73029]: 
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6144b22-7797-4fe3-9012-df7d19b63b01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260]
Aug 10 01:13:38 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260] successful.
Aug 10 01:13:38 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[815cbbc4-5f9e-46eb-b443-58caf083edfa]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a551d6a-6a60-4165-a3b5-a4bdf860d77a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)
Aug 10 01:13:38 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)
Aug 10 01:13:38 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b62b3f-5816-4321-88cb-6d766fe2cc67]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:13:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCoJOyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:13:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:13:39 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23837646338363639', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:13:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837646338363639', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:13:39 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:13:39 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:13:39 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:13:39 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:13:39 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:13:39 user nova-compute[73029]:   <serial>ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e</serial>
Aug 10 01:13:39 user nova-compute[73029]: </disk>
Aug 10 01:13:39 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:13:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:13:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:13:40 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No VIF found with MAC fa:16:3e:85:e4:bc, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:13:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8a0dae9-6f8a-45af-bd6e-461e1d421cea tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.988s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c311ab4-8960-4f41-bab4-f674446d126e tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c311ab4-8960-4f41-bab4-f674446d126e tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c311ab4-8960-4f41-bab4-f674446d126e tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c311ab4-8960-4f41-bab4-f674446d126e tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73029) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8c311ab4-8960-4f41-bab4-f674446d126e tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-bdee08ca-e4de-4a45-b102-6ce5d5c80640 req-198ee741-ff05-4979-8422-cc9ec032515d service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-unplugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bdee08ca-e4de-4a45-b102-6ce5d5c80640 req-198ee741-ff05-4979-8422-cc9ec032515d service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bdee08ca-e4de-4a45-b102-6ce5d5c80640 req-198ee741-ff05-4979-8422-cc9ec032515d service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bdee08ca-e4de-4a45-b102-6ce5d5c80640 req-198ee741-ff05-4979-8422-cc9ec032515d service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:13:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-bdee08ca-e4de-4a45-b102-6ce5d5c80640 req-198ee741-ff05-4979-8422-cc9ec032515d service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-unplugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:13:41 user nova-compute[73029]: WARNING nova.compute.manager [req-bdee08ca-e4de-4a45-b102-6ce5d5c80640 req-198ee741-ff05-4979-8422-cc9ec032515d service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-unplugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state active and task_state powering-off.
Aug 10 01:13:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:42 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance destroyed successfully.
Aug 10 01:13:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8c311ab4-8960-4f41-bab4-f674446d126e tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:13:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8c311ab4-8960-4f41-bab4-f674446d126e tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.898s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:13:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-0efd30de-bf17-4b82-ad8b-d3a6704e88a9 req-b45e2320-1d2f-45e1-a201-86ea438496aa service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:13:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0efd30de-bf17-4b82-ad8b-d3a6704e88a9 req-b45e2320-1d2f-45e1-a201-86ea438496aa service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:13:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0efd30de-bf17-4b82-ad8b-d3a6704e88a9 req-b45e2320-1d2f-45e1-a201-86ea438496aa service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:13:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0efd30de-bf17-4b82-ad8b-d3a6704e88a9 req-b45e2320-1d2f-45e1-a201-86ea438496aa service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:13:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-0efd30de-bf17-4b82-ad8b-d3a6704e88a9 req-b45e2320-1d2f-45e1-a201-86ea438496aa service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:13:43 user nova-compute[73029]: WARNING nova.compute.manager [req-0efd30de-bf17-4b82-ad8b-d3a6704e88a9 req-b45e2320-1d2f-45e1-a201-86ea438496aa service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state stopped and task_state None.
Aug 10 01:13:44 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:13:48 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:13:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:13:53 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:13:53 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:13:53 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=25.10741424560547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:13:53 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:13:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:13:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:13:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:13:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:57 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691630022.1710742, b674e3df-c413-4306-b3cf-8f872abee7fe => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:13:57 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] VM Stopped (Lifecycle Event)
Aug 10 01:13:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-98a9b217-5aad-4e74-85a1-eca51e0f3596 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:13:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-98a9b217-5aad-4e74-85a1-eca51e0f3596 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:13:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:13:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:14:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:14:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:08 user nova-compute[73029]: INFO nova.compute.manager [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Unshelving
Aug 10 01:14:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'pci_requests' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:14:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:14:09 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:14:09 user nova-compute[73029]: INFO nova.compute.claims [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Claim successful on node user
Aug 10 01:14:09 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:14:09 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:14:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:09 user nova-compute[73029]: INFO nova.network.neutron [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating port 60f22e9b-b386-4ee8-9309-8377b000884e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 10 01:14:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-54892b94-1061-46f8-9a7e-75be15ccf0ab req-efcc8876-29cd-4d69-aae8-d2e66b772ff4 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-changed-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-54892b94-1061-46f8-9a7e-75be15ccf0ab req-efcc8876-29cd-4d69-aae8-d2e66b772ff4 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Refreshing instance network info cache due to event network-changed-60f22e9b-b386-4ee8-9309-8377b000884e. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-54892b94-1061-46f8-9a7e-75be15ccf0ab req-efcc8876-29cd-4d69-aae8-d2e66b772ff4 service nova] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:14:10 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Creating image(s)
Aug 10 01:14:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-54892b94-1061-46f8-9a7e-75be15ccf0ab req-efcc8876-29cd-4d69-aae8-d2e66b772ff4 service nova] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG nova.network.neutron [req-54892b94-1061-46f8-9a7e-75be15ccf0ab req-efcc8876-29cd-4d69-aae8-d2e66b772ff4 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Refreshing network info cache for port 60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "b42d9d0768e49e3623355b93b47864eea08ec668" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "b42d9d0768e49e3623355b93b47864eea08ec668" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668.part --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:11 user nova-compute[73029]: DEBUG nova.virt.images [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] a278419b-246c-4eee-9a4f-acf247966c5b was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 01:14:11 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 01:14:11 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668.part /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-54892b94-1061-46f8-9a7e-75be15ccf0ab req-efcc8876-29cd-4d69-aae8-d2e66b772ff4 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updated VIF entry in instance network info cache for port 60f22e9b-b386-4ee8-9309-8377b000884e. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:14:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-54892b94-1061-46f8-9a7e-75be15ccf0ab req-efcc8876-29cd-4d69-aae8-d2e66b772ff4 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:14:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-54892b94-1061-46f8-9a7e-75be15ccf0ab req-efcc8876-29cd-4d69-aae8-d2e66b772ff4 service nova] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668.part /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668.converted" returned: 0 in 0.862s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "b42d9d0768e49e3623355b93b47864eea08ec668" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.223s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668 --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "b42d9d0768e49e3623355b93b47864eea08ec668" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "b42d9d0768e49e3623355b93b47864eea08ec668" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668 --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668,backing_fmt=raw /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668,backing_fmt=raw /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk 1073741824" returned: 0 in 0.050s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "b42d9d0768e49e3623355b93b47864eea08ec668" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668 --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668 --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:13 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'migration_context' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:14:13 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Rebasing disk image.
Aug 10 01:14:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf -F raw /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf -F raw /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk" returned: 0 in 2.057s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Ensure instance console log exists: /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Start _get_guest_xml network_info=[{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='12a3bd90a2bc34e3a5fe1960469a5324',container_format='bare',created_at=2023-08-10T01:12:16Z,direct_url=<?>,disk_format='qcow2',id=a278419b-246c-4eee-9a4f-acf247966c5b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1044431689-shelved',owner='6ed8b4d1eded488da4e1dc7c699bf32b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-10T01:12:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:14:15 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:14:15 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='12a3bd90a2bc34e3a5fe1960469a5324',container_format='bare',created_at=2023-08-10T01:12:16Z,direct_url=<?>,disk_format='qcow2',id=a278419b-246c-4eee-9a4f-acf247966c5b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1044431689-shelved',owner='6ed8b4d1eded488da4e1dc7c699bf32b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-10T01:12:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T01:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1044431689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1044431689',id=38,image_ref='a278419b-246c-4eee-9a4f-acf247966c5b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-581583587',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:10:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-1eby2eds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member',shelved_at='2023-08-10T01:12:19.973592',shelved_host='user',shelved_image_id='a278419b-246c-4eee-9a4f-acf247966c5b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=3a028430-195c-46aa-b49d-edc268f0af8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:14:15 user nova-compute[73029]:   <uuid>3a028430-195c-46aa-b49d-edc268f0af8d</uuid>
Aug 10 01:14:15 user nova-compute[73029]:   <name>instance-00000026</name>
Aug 10 01:14:15 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:14:15 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:14:15 user nova-compute[73029]:   <metadata>
Aug 10 01:14:15 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:14:15 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:14:15 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1044431689</nova:name>
Aug 10 01:14:15 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:14:15</nova:creationTime>
Aug 10 01:14:15 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:14:15 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:14:15 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:14:15 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:14:15 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:14:15 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:14:15 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:14:15 user nova-compute[73029]:       <nova:owner>
Aug 10 01:14:15 user nova-compute[73029]:         <nova:user uuid="45605bba94154ec797f1be53cd778876">tempest-AttachVolumeShelveTestJSON-2077435926-project-member</nova:user>
Aug 10 01:14:15 user nova-compute[73029]:         <nova:project uuid="6ed8b4d1eded488da4e1dc7c699bf32b">tempest-AttachVolumeShelveTestJSON-2077435926</nova:project>
Aug 10 01:14:15 user nova-compute[73029]:       </nova:owner>
Aug 10 01:14:15 user nova-compute[73029]:       <nova:root type="image" uuid="a278419b-246c-4eee-9a4f-acf247966c5b"/>
Aug 10 01:14:15 user nova-compute[73029]:       <nova:ports>
Aug 10 01:14:15 user nova-compute[73029]:         <nova:port uuid="60f22e9b-b386-4ee8-9309-8377b000884e">
Aug 10 01:14:15 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 01:14:15 user nova-compute[73029]:         </nova:port>
Aug 10 01:14:15 user nova-compute[73029]:       </nova:ports>
Aug 10 01:14:15 user nova-compute[73029]:     </nova:instance>
Aug 10 01:14:15 user nova-compute[73029]:   </metadata>
Aug 10 01:14:15 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:14:15 user nova-compute[73029]:     <system>
Aug 10 01:14:15 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:14:15 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:14:15 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:14:15 user nova-compute[73029]:       <entry name="serial">3a028430-195c-46aa-b49d-edc268f0af8d</entry>
Aug 10 01:14:15 user nova-compute[73029]:       <entry name="uuid">3a028430-195c-46aa-b49d-edc268f0af8d</entry>
Aug 10 01:14:15 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:14:15 user nova-compute[73029]:     </system>
Aug 10 01:14:15 user nova-compute[73029]:   </sysinfo>
Aug 10 01:14:15 user nova-compute[73029]:   <os>
Aug 10 01:14:15 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:14:15 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:14:15 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:14:15 user nova-compute[73029]:   </os>
Aug 10 01:14:15 user nova-compute[73029]:   <features>
Aug 10 01:14:15 user nova-compute[73029]:     <acpi/>
Aug 10 01:14:15 user nova-compute[73029]:     <apic/>
Aug 10 01:14:15 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:14:15 user nova-compute[73029]:   </features>
Aug 10 01:14:15 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:14:15 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:14:15 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:14:15 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:14:15 user nova-compute[73029]:   </clock>
Aug 10 01:14:15 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:14:15 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:14:15 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:14:15 user nova-compute[73029]:   </cpu>
Aug 10 01:14:15 user nova-compute[73029]:   <devices>
Aug 10 01:14:15 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:14:15 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:14:15 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk"/>
Aug 10 01:14:15 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:14:15 user nova-compute[73029]:     </disk>
Aug 10 01:14:15 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:14:15 user nova-compute[73029]:       <mac address="fa:16:3e:f6:cf:4b"/>
Aug 10 01:14:15 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:14:15 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:14:15 user nova-compute[73029]:       <target dev="tap60f22e9b-b3"/>
Aug 10 01:14:15 user nova-compute[73029]:     </interface>
Aug 10 01:14:15 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:14:15 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/console.log" append="off"/>
Aug 10 01:14:15 user nova-compute[73029]:     </serial>
Aug 10 01:14:15 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:14:15 user nova-compute[73029]:     <video>
Aug 10 01:14:15 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:14:15 user nova-compute[73029]:     </video>
Aug 10 01:14:15 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:14:15 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:14:15 user nova-compute[73029]:     </rng>
Aug 10 01:14:15 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:14:15 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:14:15 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:14:15 user nova-compute[73029]:     </memballoon>
Aug 10 01:14:15 user nova-compute[73029]:   </devices>
Aug 10 01:14:15 user nova-compute[73029]: </domain>
Aug 10 01:14:15 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T01:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1044431689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1044431689',id=38,image_ref='a278419b-246c-4eee-9a4f-acf247966c5b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-581583587',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:10:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-1eby2eds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member',shelved_at='2023-08-10T01:12:19.973592',shelved_host='user',shelved_image_id='a278419b-246c-4eee-9a4f-acf247966c5b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=3a028430-195c-46aa-b49d-edc268f0af8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG os_vif [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f22e9b-b3, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60f22e9b-b3, col_values=(('external_ids', {'iface-id': '60f22e9b-b386-4ee8-9309-8377b000884e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:cf:4b', 'vm-uuid': '3a028430-195c-46aa-b49d-edc268f0af8d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:15 user nova-compute[73029]: INFO os_vif [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3')
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:14:15 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] No VIF found with MAC fa:16:3e:f6:cf:4b, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:14:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:17 user nova-compute[73029]: DEBUG nova.compute.manager [req-f5c078be-90cd-429d-b7a1-90fb664c5cb5 req-61e8e6da-d72b-490d-b5b0-cea219b24c71 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:14:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f5c078be-90cd-429d-b7a1-90fb664c5cb5 req-61e8e6da-d72b-490d-b5b0-cea219b24c71 service nova] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f5c078be-90cd-429d-b7a1-90fb664c5cb5 req-61e8e6da-d72b-490d-b5b0-cea219b24c71 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f5c078be-90cd-429d-b7a1-90fb664c5cb5 req-61e8e6da-d72b-490d-b5b0-cea219b24c71 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:17 user nova-compute[73029]: DEBUG nova.compute.manager [req-f5c078be-90cd-429d-b7a1-90fb664c5cb5 req-61e8e6da-d72b-490d-b5b0-cea219b24c71 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] No waiting events found dispatching network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:14:17 user nova-compute[73029]: WARNING nova.compute.manager [req-f5c078be-90cd-429d-b7a1-90fb664c5cb5 req-61e8e6da-d72b-490d-b5b0-cea219b24c71 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received unexpected event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 10 01:14:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630059.1101518, 3a028430-195c-46aa-b49d-edc268f0af8d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:14:19 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] VM Resumed (Lifecycle Event)
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:14:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance spawned successfully.
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:14:19 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630059.1123848, 3a028430-195c-46aa-b49d-edc268f0af8d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:14:19 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] VM Started (Lifecycle Event)
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:14:19 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-25672d94-a26d-4b7a-a501-458ad7c83be4 req-f59fc340-426e-4865-9324-5635d68a15b2 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:14:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-25672d94-a26d-4b7a-a501-458ad7c83be4 req-f59fc340-426e-4865-9324-5635d68a15b2 service nova] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-25672d94-a26d-4b7a-a501-458ad7c83be4 req-f59fc340-426e-4865-9324-5635d68a15b2 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-25672d94-a26d-4b7a-a501-458ad7c83be4 req-f59fc340-426e-4865-9324-5635d68a15b2 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-25672d94-a26d-4b7a-a501-458ad7c83be4 req-f59fc340-426e-4865-9324-5635d68a15b2 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] No waiting events found dispatching network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:14:19 user nova-compute[73029]: WARNING nova.compute.manager [req-25672d94-a26d-4b7a-a501-458ad7c83be4 req-f59fc340-426e-4865-9324-5635d68a15b2 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received unexpected event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 10 01:14:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:14:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4c5d39e0-de4d-4f59-94ad-cd87533db643 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.564s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:14:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:14:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:14:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:14:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:14:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [{"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-3a028430-195c-46aa-b49d-edc268f0af8d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:14:48 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:14:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:14:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:14:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:14:53 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:14:54 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:14:54 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:14:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=25.081077575683594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3a028430-195c-46aa-b49d-edc268f0af8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:14:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:14:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:14:58 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:00 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:15:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:15:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:15:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:15:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:15:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:15:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:15:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:15:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:15:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG nova.objects.instance [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG nova.network.neutron [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG nova.objects.instance [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'info_cache' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG nova.network.neutron [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:15:32 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance destroyed successfully.
Aug 10 01:15:32 user nova-compute[73029]: DEBUG nova.objects.instance [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'resources' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776952036',display_name='tempest-AttachVolumeTestJSON-server-776952036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776952036',id=39,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAKK0VG3VaK5fUTIrsIMgv2KdcKIveiKEuYPJ3NPT6NMJIrLKchH0nOOACYfezLlyV+Jwy2xpwEI2ExcJ8Dbxy7zTcu6IqOZv7ilbVXlr1d2IPY0JmgEfup+rNLgIEoxA==',key_name='tempest-keypair-986600418',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-3wyvwgei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:13:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=b674e3df-c413-4306-b3cf-8f872abee7fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG os_vif [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa802fdef-f3, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:32 user nova-compute[73029]: INFO os_vif [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3')
Aug 10 01:15:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCoJOyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:15:32 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:15:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4face6-499d-465e-993f-2406bca5d810]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4368aff4-2986-4bc3-84cc-442bb671f9a9]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)
Aug 10 01:15:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)
Aug 10 01:15:32 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f078d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:15:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b806d6-98b0-4be3-8c64-c702c1605d41]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d168e54-0f3f-409d-8a06-efc7a5c62309]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[90111974-e011-4667-9c61-25608d4315f1]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c38e080-9b2a-4367-8dfd-357a7df2b74b]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4286f395-91b1-4290-b8c8-af3e4aecc385]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8265af78-824e-44b3-9c34-2cff74f4bb68]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260]
Aug 10 01:15:33 user nova-compute[73029]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260] successful.
Aug 10 01:15:33 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0489190-196c-4edd-bd39-22a7652c74ce]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== disconnect_volume: return (285ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Start _get_guest_xml network_info=[{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'eeb39b63-d7ae-4804-8821-c10dc2fc3030', 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCoJOyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b674e3df-c413-4306-b3cf-8f872abee7fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e', 'serial': 'ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.objects.instance [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'numa_topology' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:15:33 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:15:33 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.objects.instance [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'vcpu_model' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCoJOyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:15:33 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:15:33 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:15:33 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b2acce-40cc-4f27-93fe-1aa3d001e352]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:15:33 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd44ed3-3ae1-4bf5-88ad-e1d45fe37a6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e] added
Aug 10 01:15:33 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7dcb30-4312-4f5b-a8b4-3ea152869ffe]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e24a15f-afae-428e-924b-430b57730651]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMCoJOyj {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMCoJOyj" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaae9f5-27fa-4dee-81d9-1250ad5223e7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UMCoJOyj'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b917bd41-3b72-4aff-aa18-0313fa69f994]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b3f1be-9b25-4f0d-a3e1-c31d4441e1d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:15:33 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:15:33 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:15:33 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:15:33 user nova-compute[73029]: 
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d79199-04d9-408e-bc89-87f2faf29f87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260]
Aug 10 01:15:33 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260] successful.
Aug 10 01:15:33 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96b640d-2b1a-46ec-b245-ffd2ffadb17a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0dd17f-f076-4d46-8a66-9d285a567572]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)
Aug 10 01:15:33 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)
Aug 10 01:15:33 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a6888f-160e-492a-ae7d-4c6039df1a29]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:15:33 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCoJOyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23837646338363639', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837646338363639', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776952036',display_name='tempest-AttachVolumeTestJSON-server-776952036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776952036',id=39,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAKK0VG3VaK5fUTIrsIMgv2KdcKIveiKEuYPJ3NPT6NMJIrLKchH0nOOACYfezLlyV+Jwy2xpwEI2ExcJ8Dbxy7zTcu6IqOZv7ilbVXlr1d2IPY0JmgEfup+rNLgIEoxA==',key_name='tempest-keypair-986600418',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-3wyvwgei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:13:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=b674e3df-c413-4306-b3cf-8f872abee7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'pci_devices' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:15:34 user nova-compute[73029]:   <uuid>b674e3df-c413-4306-b3cf-8f872abee7fe</uuid>
Aug 10 01:15:34 user nova-compute[73029]:   <name>instance-00000027</name>
Aug 10 01:15:34 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:15:34 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:15:34 user nova-compute[73029]:   <metadata>
Aug 10 01:15:34 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:15:34 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:15:34 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeTestJSON-server-776952036</nova:name>
Aug 10 01:15:34 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:15:33</nova:creationTime>
Aug 10 01:15:34 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:15:34 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:15:34 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:15:34 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:15:34 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:15:34 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:15:34 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:15:34 user nova-compute[73029]:       <nova:owner>
Aug 10 01:15:34 user nova-compute[73029]:         <nova:user uuid="b8ab867cd18c4fbfb8c38f2d4666be8e">tempest-AttachVolumeTestJSON-1442739203-project-member</nova:user>
Aug 10 01:15:34 user nova-compute[73029]:         <nova:project uuid="27575d6efb9a45b2b9b38f2bbed286ec">tempest-AttachVolumeTestJSON-1442739203</nova:project>
Aug 10 01:15:34 user nova-compute[73029]:       </nova:owner>
Aug 10 01:15:34 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:15:34 user nova-compute[73029]:       <nova:ports>
Aug 10 01:15:34 user nova-compute[73029]:         <nova:port uuid="a802fdef-f355-4ad7-8d8c-8bc5982152fa">
Aug 10 01:15:34 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 01:15:34 user nova-compute[73029]:         </nova:port>
Aug 10 01:15:34 user nova-compute[73029]:       </nova:ports>
Aug 10 01:15:34 user nova-compute[73029]:     </nova:instance>
Aug 10 01:15:34 user nova-compute[73029]:   </metadata>
Aug 10 01:15:34 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:15:34 user nova-compute[73029]:     <system>
Aug 10 01:15:34 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:15:34 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:15:34 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:15:34 user nova-compute[73029]:       <entry name="serial">b674e3df-c413-4306-b3cf-8f872abee7fe</entry>
Aug 10 01:15:34 user nova-compute[73029]:       <entry name="uuid">b674e3df-c413-4306-b3cf-8f872abee7fe</entry>
Aug 10 01:15:34 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:15:34 user nova-compute[73029]:     </system>
Aug 10 01:15:34 user nova-compute[73029]:   </sysinfo>
Aug 10 01:15:34 user nova-compute[73029]:   <os>
Aug 10 01:15:34 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:15:34 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:15:34 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:15:34 user nova-compute[73029]:   </os>
Aug 10 01:15:34 user nova-compute[73029]:   <features>
Aug 10 01:15:34 user nova-compute[73029]:     <acpi/>
Aug 10 01:15:34 user nova-compute[73029]:     <apic/>
Aug 10 01:15:34 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:15:34 user nova-compute[73029]:   </features>
Aug 10 01:15:34 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:15:34 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:15:34 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:15:34 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:15:34 user nova-compute[73029]:   </clock>
Aug 10 01:15:34 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:15:34 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:15:34 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:15:34 user nova-compute[73029]:   </cpu>
Aug 10 01:15:34 user nova-compute[73029]:   <devices>
Aug 10 01:15:34 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:15:34 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:15:34 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk"/>
Aug 10 01:15:34 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:15:34 user nova-compute[73029]:     </disk>
Aug 10 01:15:34 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:15:34 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:15:34 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 01:15:34 user nova-compute[73029]:       <target dev="vdb" bus="virtio"/>
Aug 10 01:15:34 user nova-compute[73029]:       <serial>ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e</serial>
Aug 10 01:15:34 user nova-compute[73029]:     </disk>
Aug 10 01:15:34 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:15:34 user nova-compute[73029]:       <mac address="fa:16:3e:85:e4:bc"/>
Aug 10 01:15:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:15:34 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:15:34 user nova-compute[73029]:       <target dev="tapa802fdef-f3"/>
Aug 10 01:15:34 user nova-compute[73029]:     </interface>
Aug 10 01:15:34 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:15:34 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/console.log" append="off"/>
Aug 10 01:15:34 user nova-compute[73029]:     </serial>
Aug 10 01:15:34 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:15:34 user nova-compute[73029]:     <video>
Aug 10 01:15:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:15:34 user nova-compute[73029]:     </video>
Aug 10 01:15:34 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:15:34 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:15:34 user nova-compute[73029]:     </rng>
Aug 10 01:15:34 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:15:34 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:15:34 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:15:34 user nova-compute[73029]:     </memballoon>
Aug 10 01:15:34 user nova-compute[73029]:   </devices>
Aug 10 01:15:34 user nova-compute[73029]: </domain>
Aug 10 01:15:34 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG nova.objects.instance [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'trusted_certs' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Cannot resize image /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG nova.objects.instance [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'migration_context' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776952036',display_name='tempest-AttachVolumeTestJSON-server-776952036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776952036',id=39,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAKK0VG3VaK5fUTIrsIMgv2KdcKIveiKEuYPJ3NPT6NMJIrLKchH0nOOACYfezLlyV+Jwy2xpwEI2ExcJ8Dbxy7zTcu6IqOZv7ilbVXlr1d2IPY0JmgEfup+rNLgIEoxA==',key_name='tempest-keypair-986600418',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-3wyvwgei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:13:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=b674e3df-c413-4306-b3cf-8f872abee7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG os_vif [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa802fdef-f3, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa802fdef-f3, col_values=(('external_ids', {'iface-id': 'a802fdef-f355-4ad7-8d8c-8bc5982152fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:e4:bc', 'vm-uuid': 'b674e3df-c413-4306-b3cf-8f872abee7fe'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:35 user nova-compute[73029]: INFO os_vif [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3')
Aug 10 01:15:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-21fdc9dc-a3b3-4285-82be-a4e1a382c51e req-95622c6c-36d9-4134-b446-169a0cb0a277 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:15:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-21fdc9dc-a3b3-4285-82be-a4e1a382c51e req-95622c6c-36d9-4134-b446-169a0cb0a277 service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:15:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-21fdc9dc-a3b3-4285-82be-a4e1a382c51e req-95622c6c-36d9-4134-b446-169a0cb0a277 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:15:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-21fdc9dc-a3b3-4285-82be-a4e1a382c51e req-95622c6c-36d9-4134-b446-169a0cb0a277 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:15:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-21fdc9dc-a3b3-4285-82be-a4e1a382c51e req-95622c6c-36d9-4134-b446-169a0cb0a277 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:15:36 user nova-compute[73029]: WARNING nova.compute.manager [req-21fdc9dc-a3b3-4285-82be-a4e1a382c51e req-95622c6c-36d9-4134-b446-169a0cb0a277 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state stopped and task_state powering-on.
Aug 10 01:15:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630138.8611515, b674e3df-c413-4306-b3cf-8f872abee7fe => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:15:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] VM Resumed (Lifecycle Event)
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:15:38 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance rebooted successfully.
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-af744251-5ebd-4e56-b775-bb53ee0fd316 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:15:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630138.862565, b674e3df-c413-4306-b3cf-8f872abee7fe => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:15:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] VM Started (Lifecycle Event)
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-156f175e-41c1-481f-b5af-96b694a26b43 req-73091435-632b-47ac-b792-7b93b3e71b77 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-156f175e-41c1-481f-b5af-96b694a26b43 req-73091435-632b-47ac-b792-7b93b3e71b77 service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-156f175e-41c1-481f-b5af-96b694a26b43 req-73091435-632b-47ac-b792-7b93b3e71b77 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-156f175e-41c1-481f-b5af-96b694a26b43 req-73091435-632b-47ac-b792-7b93b3e71b77 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:15:38 user nova-compute[73029]: DEBUG nova.compute.manager [req-156f175e-41c1-481f-b5af-96b694a26b43 req-73091435-632b-47ac-b792-7b93b3e71b77 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:15:38 user nova-compute[73029]: WARNING nova.compute.manager [req-156f175e-41c1-481f-b5af-96b694a26b43 req-73091435-632b-47ac-b792-7b93b3e71b77 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state active and task_state None.
Aug 10 01:15:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:49 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:15:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:15:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:15:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:15:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:15:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:15:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:15:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:15:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:15:55 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:15:55 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:15:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=25.07978057861328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3a028430-195c-46aa-b49d-edc268f0af8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:15:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:15:57 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:15:59 user nova-compute[73029]: INFO nova.compute.manager [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Terminating instance
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-26d25c76-53cd-4ab8-96fa-0970245406db req-9dc3494f-ba1b-4ef0-88d2-350d3b01a882 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-unplugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-26d25c76-53cd-4ab8-96fa-0970245406db req-9dc3494f-ba1b-4ef0-88d2-350d3b01a882 service nova] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-26d25c76-53cd-4ab8-96fa-0970245406db req-9dc3494f-ba1b-4ef0-88d2-350d3b01a882 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-26d25c76-53cd-4ab8-96fa-0970245406db req-9dc3494f-ba1b-4ef0-88d2-350d3b01a882 service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-26d25c76-53cd-4ab8-96fa-0970245406db req-9dc3494f-ba1b-4ef0-88d2-350d3b01a882 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] No waiting events found dispatching network-vif-unplugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.compute.manager [req-26d25c76-53cd-4ab8-96fa-0970245406db req-9dc3494f-ba1b-4ef0-88d2-350d3b01a882 service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-unplugged-60f22e9b-b386-4ee8-9309-8377b000884e for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Instance destroyed successfully.
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lazy-loading 'resources' on Instance uuid 3a028430-195c-46aa-b49d-edc268f0af8d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T01:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1044431689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1044431689',id=38,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqF4kgiKJ2Kqry4+GrFE3F81X4Q0b2bdkt3oou82AyCK29olxhUFKM8V1WLwz6rvRMJsyMp4Uqj7R8/HlKgVAmUEe8SbzK30gxT/epVueftJ2XaNxWimGsqzduwpnsDpA==',key_name='tempest-keypair-581583587',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:14:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ed8b4d1eded488da4e1dc7c699bf32b',ramdisk_id='',reservation_id='r-1eby2eds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2077435926',owner_user_name='tempest-AttachVolumeShelveTestJSON-2077435926-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:14:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45605bba94154ec797f1be53cd778876',uuid=3a028430-195c-46aa-b49d-edc268f0af8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converting VIF {"id": "60f22e9b-b386-4ee8-9309-8377b000884e", "address": "fa:16:3e:f6:cf:4b", "network": {"id": "6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1291654574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ed8b4d1eded488da4e1dc7c699bf32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f22e9b-b3", "ovs_interfaceid": "60f22e9b-b386-4ee8-9309-8377b000884e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG os_vif [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f22e9b-b3, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:15:59 user nova-compute[73029]: INFO os_vif [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f22e9b-b386-4ee8-9309-8377b000884e,network=Network(6deccf9a-e7a9-41f7-b2ac-bf160dc45b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f22e9b-b3')
Aug 10 01:15:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Deleting instance files /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d_del
Aug 10 01:15:59 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Deletion of /opt/stack/data/nova/instances/3a028430-195c-46aa-b49d-edc268f0af8d_del complete
Aug 10 01:15:59 user nova-compute[73029]: INFO nova.compute.manager [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 10 01:15:59 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:15:59 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:16:00 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:16:00 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Took 0.84 seconds to deallocate network for instance.
Aug 10 01:16:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:16:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:16:00 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:16:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:16:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:16:01 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:16:01 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Deleted allocations for instance 3a028430-195c-46aa-b49d-edc268f0af8d
Aug 10 01:16:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0a2b779b-e8c7-4a78-892b-fafde03cb1b6 tempest-AttachVolumeShelveTestJSON-2077435926 tempest-AttachVolumeShelveTestJSON-2077435926-project-member] Lock "3a028430-195c-46aa-b49d-edc268f0af8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.014s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:16:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-0e484a93-5099-4aa4-b980-96b469412db0 req-7ca4b73f-6af1-477e-95f6-6e0ab8294e8d service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:16:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0e484a93-5099-4aa4-b980-96b469412db0 req-7ca4b73f-6af1-477e-95f6-6e0ab8294e8d service nova] Acquiring lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:16:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0e484a93-5099-4aa4-b980-96b469412db0 req-7ca4b73f-6af1-477e-95f6-6e0ab8294e8d service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:16:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0e484a93-5099-4aa4-b980-96b469412db0 req-7ca4b73f-6af1-477e-95f6-6e0ab8294e8d service nova] Lock "3a028430-195c-46aa-b49d-edc268f0af8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:16:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-0e484a93-5099-4aa4-b980-96b469412db0 req-7ca4b73f-6af1-477e-95f6-6e0ab8294e8d service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] No waiting events found dispatching network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:16:01 user nova-compute[73029]: WARNING nova.compute.manager [req-0e484a93-5099-4aa4-b980-96b469412db0 req-7ca4b73f-6af1-477e-95f6-6e0ab8294e8d service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received unexpected event network-vif-plugged-60f22e9b-b386-4ee8-9309-8377b000884e for instance with vm_state deleted and task_state None.
Aug 10 01:16:01 user nova-compute[73029]: DEBUG nova.compute.manager [req-0e484a93-5099-4aa4-b980-96b469412db0 req-7ca4b73f-6af1-477e-95f6-6e0ab8294e8d service nova] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Received event network-vif-deleted-60f22e9b-b386-4ee8-9309-8377b000884e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:16:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:14 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691630159.874092, 3a028430-195c-46aa-b49d-edc268f0af8d => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:16:14 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] VM Stopped (Lifecycle Event)
Aug 10 01:16:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1ac44dd8-41bc-460a-a6dc-103c6bc03f9f None None] [instance: 3a028430-195c-46aa-b49d-edc268f0af8d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:16:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:16:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:16:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:16:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:16:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:16:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:16:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:16:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:16:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:16:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:16:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:16:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:16:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:16:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:16:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:16:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:16:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:16:54 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:16:54 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:16:54 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.098941802978516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:16:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:16:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:16:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:17:01 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:01 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:17:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:17:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:17:04 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:17:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:17:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:17:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:17:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:17:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:17:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:23 user nova-compute[73029]: INFO nova.compute.manager [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Detaching volume ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e
Aug 10 01:17:23 user nova-compute[73029]: INFO nova.virt.block_device [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Attempting to driver detach volume ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e from mountpoint /dev/vdb
Aug 10 01:17:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Attempting to detach device vdb from instance b674e3df-c413-4306-b3cf-8f872abee7fe from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:17:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:17:23 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:17:23 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:17:23 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:17:23 user nova-compute[73029]:   <serial>ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e</serial>
Aug 10 01:17:23 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 10 01:17:23 user nova-compute[73029]: </disk>
Aug 10 01:17:23 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:17:23 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully detached device vdb from instance b674e3df-c413-4306-b3cf-8f872abee7fe from the persistent domain config.
Aug 10 01:17:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b674e3df-c413-4306-b3cf-8f872abee7fe from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:17:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:17:23 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:17:23 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:17:23 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:17:23 user nova-compute[73029]:   <serial>ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e</serial>
Aug 10 01:17:23 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 10 01:17:23 user nova-compute[73029]: </disk>
Aug 10 01:17:23 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691630244.0565612, b674e3df-c413-4306-b3cf-8f872abee7fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:17:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully detached device vdb from instance b674e3df-c413-4306-b3cf-8f872abee7fe from the live domain config.
Aug 10 01:17:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCoJOyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:17:24 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffacbf72-aa88-475d-af32-4f12354be35a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2713cf6d-1cc7-438d-8fd2-9ea2a57209b6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)
Aug 10 01:17:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e (non-flash)
Aug 10 01:17:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141a7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ffcd4-029c-4bfa-a857-b783b41c1da8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f700725-cc13-4734-a5be-6212c6fd5167]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff03aceb-7459-496a-aef0-31b87d96beaf]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbff7791-5016-4ce9-b257-b00558468473]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c26f8-12ea-49cf-bb7f-e93e7fbbe293]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a95e11-9b48-494a-aa5e-c6f4c9d70916]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260]
Aug 10 01:17:24 user nova-compute[73029]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e, portal: 172.16.0.220,3260] successful.
Aug 10 01:17:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2b8d17-6d0f-4fa1-bb90-192731fa1d8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d599785a-7866-4b1b-a2bb-fabdde81ab19]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== disconnect_volume: return (267ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:17:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG nova.objects.instance [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-ad6d792c-4120-4fd2-8754-c98d8387c7f9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.610s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3713c3f7-a686-41d8-96a0-b7271ba5ecc4 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3713c3f7-a686-41d8-96a0-b7271ba5ecc4 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-3713c3f7-a686-41d8-96a0-b7271ba5ecc4 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-3713c3f7-a686-41d8-96a0-b7271ba5ecc4 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73029) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG nova.objects.instance [None req-3713c3f7-a686-41d8-96a0-b7271ba5ecc4 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-88399ce5-567d-4a55-bf21-e9d639e8002f req-0298fe98-a87a-4fda-96c7-109273b8d2e6 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-unplugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:17:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-88399ce5-567d-4a55-bf21-e9d639e8002f req-0298fe98-a87a-4fda-96c7-109273b8d2e6 service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-88399ce5-567d-4a55-bf21-e9d639e8002f req-0298fe98-a87a-4fda-96c7-109273b8d2e6 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-88399ce5-567d-4a55-bf21-e9d639e8002f req-0298fe98-a87a-4fda-96c7-109273b8d2e6 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-88399ce5-567d-4a55-bf21-e9d639e8002f req-0298fe98-a87a-4fda-96c7-109273b8d2e6 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-unplugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:17:26 user nova-compute[73029]: WARNING nova.compute.manager [req-88399ce5-567d-4a55-bf21-e9d639e8002f req-0298fe98-a87a-4fda-96c7-109273b8d2e6 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-unplugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state active and task_state powering-off.
Aug 10 01:17:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance destroyed successfully.
Aug 10 01:17:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-3713c3f7-a686-41d8-96a0-b7271ba5ecc4 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:17:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3713c3f7-a686-41d8-96a0-b7271ba5ecc4 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.843s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-b2c4851f-f603-42bb-b1f0-80e692dc1319 req-f1a11e30-3030-4fa0-8029-d4f0a2768268 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:17:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b2c4851f-f603-42bb-b1f0-80e692dc1319 req-f1a11e30-3030-4fa0-8029-d4f0a2768268 service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b2c4851f-f603-42bb-b1f0-80e692dc1319 req-f1a11e30-3030-4fa0-8029-d4f0a2768268 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b2c4851f-f603-42bb-b1f0-80e692dc1319 req-f1a11e30-3030-4fa0-8029-d4f0a2768268 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-b2c4851f-f603-42bb-b1f0-80e692dc1319 req-f1a11e30-3030-4fa0-8029-d4f0a2768268 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:17:28 user nova-compute[73029]: WARNING nova.compute.manager [req-b2c4851f-f603-42bb-b1f0-80e692dc1319 req-f1a11e30-3030-4fa0-8029-d4f0a2768268 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state stopped and task_state None.
Aug 10 01:17:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:41 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691630246.5301235, b674e3df-c413-4306-b3cf-8f872abee7fe => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:17:41 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] VM Stopped (Lifecycle Event)
Aug 10 01:17:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2df47073-c9a7-45a3-9134-6f20b0a8f87a None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:17:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2df47073-c9a7-45a3-9134-6f20b0a8f87a None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:17:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:17:48 user nova-compute[73029]: INFO nova.compute.claims [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Claim successful on node user
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:17:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.policy [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb2bf5ce780542cca24b37e3f929dc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bda2c5abe742c6af24393e22e87321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:17:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Creating image(s)
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "/opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "/opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.144s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk 1073741824" returned: 0 in 0.079s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Successfully created port: e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.148s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Cannot resize image /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'migration_context' on Instance uuid 3f08b34f-17b9-4657-9df0-783a74af5d5a {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Ensure instance console log exists: /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Successfully updated port: e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquired lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-706b2f81-e306-4ebb-8081-5aa713805496 req-a61a8ba4-c2e3-4fef-82f2-7e6cdd30d072 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received event network-changed-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-706b2f81-e306-4ebb-8081-5aa713805496 req-a61a8ba4-c2e3-4fef-82f2-7e6cdd30d072 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Refreshing instance network info cache due to event network-changed-e8b05472-c8b0-4943-99fd-7772e2fcb5bd. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-706b2f81-e306-4ebb-8081-5aa713805496 req-a61a8ba4-c2e3-4fef-82f2-7e6cdd30d072 service nova] Acquiring lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.network.neutron [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Updating instance_info_cache with network_info: [{"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Releasing lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Instance network_info: |[{"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-706b2f81-e306-4ebb-8081-5aa713805496 req-a61a8ba4-c2e3-4fef-82f2-7e6cdd30d072 service nova] Acquired lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.network.neutron [req-706b2f81-e306-4ebb-8081-5aa713805496 req-a61a8ba4-c2e3-4fef-82f2-7e6cdd30d072 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Refreshing network info cache for port e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Start _get_guest_xml network_info=[{"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:17:50 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:17:50 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-186580580',display_name='tempest-VolumesSnapshotTestJSON-instance-186580580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-186580580',id=40,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIriOwJPLMNRejpoHrEs8qL/Tmz0Kux4+9iUL6PLcNJAx+p7sdOaMOQ6N4arIoqROcGlwPjim55QIV/ztn/FJWlRKpjR4ES4GlGPV3RHEw7UidE+ONJa+xMpK1wIHTkeYw==',key_name='tempest-keypair-83917566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bda2c5abe742c6af24393e22e87321',ramdisk_id='',reservation_id='r-sdfl70vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1971863414',owner_user_name='tempest-VolumesSnapshotTestJSON-1971863414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2bf5ce780542cca24b37e3f929dc32',uuid=3f08b34f-17b9-4657-9df0-783a74af5d5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converting VIF {"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=e8b05472-c8b0-4943-99fd-7772e2fcb5bd,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b05472-c8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.objects.instance [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f08b34f-17b9-4657-9df0-783a74af5d5a {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:17:50 user nova-compute[73029]:   <uuid>3f08b34f-17b9-4657-9df0-783a74af5d5a</uuid>
Aug 10 01:17:50 user nova-compute[73029]:   <name>instance-00000028</name>
Aug 10 01:17:50 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:17:50 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:17:50 user nova-compute[73029]:   <metadata>
Aug 10 01:17:50 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:17:50 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:17:50 user nova-compute[73029]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-186580580</nova:name>
Aug 10 01:17:50 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:17:50</nova:creationTime>
Aug 10 01:17:50 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:17:50 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:17:50 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:17:50 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:17:50 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:17:50 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:17:50 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:17:50 user nova-compute[73029]:       <nova:owner>
Aug 10 01:17:50 user nova-compute[73029]:         <nova:user uuid="cb2bf5ce780542cca24b37e3f929dc32">tempest-VolumesSnapshotTestJSON-1971863414-project-member</nova:user>
Aug 10 01:17:50 user nova-compute[73029]:         <nova:project uuid="b7bda2c5abe742c6af24393e22e87321">tempest-VolumesSnapshotTestJSON-1971863414</nova:project>
Aug 10 01:17:50 user nova-compute[73029]:       </nova:owner>
Aug 10 01:17:50 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:17:50 user nova-compute[73029]:       <nova:ports>
Aug 10 01:17:50 user nova-compute[73029]:         <nova:port uuid="e8b05472-c8b0-4943-99fd-7772e2fcb5bd">
Aug 10 01:17:50 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 10 01:17:50 user nova-compute[73029]:         </nova:port>
Aug 10 01:17:50 user nova-compute[73029]:       </nova:ports>
Aug 10 01:17:50 user nova-compute[73029]:     </nova:instance>
Aug 10 01:17:50 user nova-compute[73029]:   </metadata>
Aug 10 01:17:50 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:17:50 user nova-compute[73029]:     <system>
Aug 10 01:17:50 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:17:50 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:17:50 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:17:50 user nova-compute[73029]:       <entry name="serial">3f08b34f-17b9-4657-9df0-783a74af5d5a</entry>
Aug 10 01:17:50 user nova-compute[73029]:       <entry name="uuid">3f08b34f-17b9-4657-9df0-783a74af5d5a</entry>
Aug 10 01:17:50 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:17:50 user nova-compute[73029]:     </system>
Aug 10 01:17:50 user nova-compute[73029]:   </sysinfo>
Aug 10 01:17:50 user nova-compute[73029]:   <os>
Aug 10 01:17:50 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:17:50 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:17:50 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:17:50 user nova-compute[73029]:   </os>
Aug 10 01:17:50 user nova-compute[73029]:   <features>
Aug 10 01:17:50 user nova-compute[73029]:     <acpi/>
Aug 10 01:17:50 user nova-compute[73029]:     <apic/>
Aug 10 01:17:50 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:17:50 user nova-compute[73029]:   </features>
Aug 10 01:17:50 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:17:50 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:17:50 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:17:50 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:17:50 user nova-compute[73029]:   </clock>
Aug 10 01:17:50 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:17:50 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:17:50 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:17:50 user nova-compute[73029]:   </cpu>
Aug 10 01:17:50 user nova-compute[73029]:   <devices>
Aug 10 01:17:50 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:17:50 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:17:50 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk"/>
Aug 10 01:17:50 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:17:50 user nova-compute[73029]:     </disk>
Aug 10 01:17:50 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:17:50 user nova-compute[73029]:       <mac address="fa:16:3e:01:ed:9c"/>
Aug 10 01:17:50 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:17:50 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:17:50 user nova-compute[73029]:       <target dev="tape8b05472-c8"/>
Aug 10 01:17:50 user nova-compute[73029]:     </interface>
Aug 10 01:17:50 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:17:50 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/console.log" append="off"/>
Aug 10 01:17:50 user nova-compute[73029]:     </serial>
Aug 10 01:17:50 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:17:50 user nova-compute[73029]:     <video>
Aug 10 01:17:50 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:17:50 user nova-compute[73029]:     </video>
Aug 10 01:17:50 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:17:50 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:17:50 user nova-compute[73029]:     </rng>
Aug 10 01:17:50 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:17:50 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:17:50 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:17:50 user nova-compute[73029]:     </memballoon>
Aug 10 01:17:50 user nova-compute[73029]:   </devices>
Aug 10 01:17:50 user nova-compute[73029]: </domain>
Aug 10 01:17:50 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-186580580',display_name='tempest-VolumesSnapshotTestJSON-instance-186580580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-186580580',id=40,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIriOwJPLMNRejpoHrEs8qL/Tmz0Kux4+9iUL6PLcNJAx+p7sdOaMOQ6N4arIoqROcGlwPjim55QIV/ztn/FJWlRKpjR4ES4GlGPV3RHEw7UidE+ONJa+xMpK1wIHTkeYw==',key_name='tempest-keypair-83917566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bda2c5abe742c6af24393e22e87321',ramdisk_id='',reservation_id='r-sdfl70vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1971863414',owner_user_name='tempest-VolumesSnapshotTestJSON-1971863414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2bf5ce780542cca24b37e3f929dc32',uuid=3f08b34f-17b9-4657-9df0-783a74af5d5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converting VIF {"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=e8b05472-c8b0-4943-99fd-7772e2fcb5bd,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b05472-c8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG os_vif [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=e8b05472-c8b0-4943-99fd-7772e2fcb5bd,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b05472-c8') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8b05472-c8, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8b05472-c8, col_values=(('external_ids', {'iface-id': 'e8b05472-c8b0-4943-99fd-7772e2fcb5bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:ed:9c', 'vm-uuid': '3f08b34f-17b9-4657-9df0-783a74af5d5a'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:50 user nova-compute[73029]: INFO os_vif [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=e8b05472-c8b0-4943-99fd-7772e2fcb5bd,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b05472-c8')
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:17:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No VIF found with MAC fa:16:3e:01:ed:9c, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:17:51 user nova-compute[73029]: DEBUG nova.network.neutron [req-706b2f81-e306-4ebb-8081-5aa713805496 req-a61a8ba4-c2e3-4fef-82f2-7e6cdd30d072 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Updated VIF entry in instance network info cache for port e8b05472-c8b0-4943-99fd-7772e2fcb5bd. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:17:51 user nova-compute[73029]: DEBUG nova.network.neutron [req-706b2f81-e306-4ebb-8081-5aa713805496 req-a61a8ba4-c2e3-4fef-82f2-7e6cdd30d072 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Updating instance_info_cache with network_info: [{"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:17:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-706b2f81-e306-4ebb-8081-5aa713805496 req-a61a8ba4-c2e3-4fef-82f2-7e6cdd30d072 service nova] Releasing lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Skipping network cache update for instance because it is Building. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-7c342df7-e639-4bf1-860b-6d67a4beb37c req-cdc64826-c4ca-4dff-a6fc-c4d9ff9419d2 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received event network-vif-plugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7c342df7-e639-4bf1-860b-6d67a4beb37c req-cdc64826-c4ca-4dff-a6fc-c4d9ff9419d2 service nova] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7c342df7-e639-4bf1-860b-6d67a4beb37c req-cdc64826-c4ca-4dff-a6fc-c4d9ff9419d2 service nova] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7c342df7-e639-4bf1-860b-6d67a4beb37c req-cdc64826-c4ca-4dff-a6fc-c4d9ff9419d2 service nova] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-7c342df7-e639-4bf1-860b-6d67a4beb37c req-cdc64826-c4ca-4dff-a6fc-c4d9ff9419d2 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] No waiting events found dispatching network-vif-plugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:17:52 user nova-compute[73029]: WARNING nova.compute.manager [req-7c342df7-e639-4bf1-860b-6d67a4beb37c req-cdc64826-c4ca-4dff-a6fc-c4d9ff9419d2 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received unexpected event network-vif-plugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd for instance with vm_state building and task_state spawning.
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630274.227652, 3f08b34f-17b9-4657-9df0-783a74af5d5a => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:17:54 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] VM Resumed (Lifecycle Event)
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:17:54 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Instance spawned successfully.
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:17:54 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630274.2317462, 3f08b34f-17b9-4657-9df0-783a74af5d5a => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:17:54 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] VM Started (Lifecycle Event)
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:17:54 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:17:54 user nova-compute[73029]: INFO nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-5ed3764a-7143-491f-afcf-8e4957d163cf req-33f36f2d-57c5-4980-abdf-bf9bced0d5ce service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received event network-vif-plugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5ed3764a-7143-491f-afcf-8e4957d163cf req-33f36f2d-57c5-4980-abdf-bf9bced0d5ce service nova] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5ed3764a-7143-491f-afcf-8e4957d163cf req-33f36f2d-57c5-4980-abdf-bf9bced0d5ce service nova] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5ed3764a-7143-491f-afcf-8e4957d163cf req-33f36f2d-57c5-4980-abdf-bf9bced0d5ce service nova] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-5ed3764a-7143-491f-afcf-8e4957d163cf req-33f36f2d-57c5-4980-abdf-bf9bced0d5ce service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] No waiting events found dispatching network-vif-plugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:17:54 user nova-compute[73029]: WARNING nova.compute.manager [req-5ed3764a-7143-491f-afcf-8e4957d163cf req-33f36f2d-57c5-4980-abdf-bf9bced0d5ce service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received unexpected event network-vif-plugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd for instance with vm_state building and task_state spawning.
Aug 10 01:17:54 user nova-compute[73029]: INFO nova.compute.manager [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Took 6.04 seconds to build instance.
Aug 10 01:17:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-8f141e8b-b523-41cb-92ee-d625241c0a45 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.186s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:17:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:17:57 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:17:57 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:17:57 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=25.095298767089844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3f08b34f-17b9-4657-9df0-783a74af5d5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:17:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:17:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:00 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:18:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:18:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:18:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:18:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:18:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:18:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:18:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:18:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:18:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:18:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:18:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:18:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:18:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:18:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:18:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:18:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:18:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:18:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:18:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:18:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:18:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.066852569580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3f08b34f-17b9-4657-9df0-783a74af5d5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:18:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:19:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:19:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:19:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:19:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:19:04 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:19:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:19:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:19:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:19:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:19:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:19:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:19:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:16 user nova-compute[73029]: DEBUG nova.objects.instance [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:19:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:19:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:19:16 user nova-compute[73029]: DEBUG nova.objects.instance [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'info_cache' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:19:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:19:17 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance destroyed successfully.
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'resources' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776952036',display_name='tempest-AttachVolumeTestJSON-server-776952036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776952036',id=39,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAKK0VG3VaK5fUTIrsIMgv2KdcKIveiKEuYPJ3NPT6NMJIrLKchH0nOOACYfezLlyV+Jwy2xpwEI2ExcJ8Dbxy7zTcu6IqOZv7ilbVXlr1d2IPY0JmgEfup+rNLgIEoxA==',key_name='tempest-keypair-986600418',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-3wyvwgei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=b674e3df-c413-4306-b3cf-8f872abee7fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG os_vif [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa802fdef-f3, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:17 user nova-compute[73029]: INFO os_vif [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3')
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Start _get_guest_xml network_info=[{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'numa_topology' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:17 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:19:17 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'vcpu_model' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776952036',display_name='tempest-AttachVolumeTestJSON-server-776952036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776952036',id=39,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAKK0VG3VaK5fUTIrsIMgv2KdcKIveiKEuYPJ3NPT6NMJIrLKchH0nOOACYfezLlyV+Jwy2xpwEI2ExcJ8Dbxy7zTcu6IqOZv7ilbVXlr1d2IPY0JmgEfup+rNLgIEoxA==',key_name='tempest-keypair-986600418',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-3wyvwgei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=b674e3df-c413-4306-b3cf-8f872abee7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'pci_devices' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:19:17 user nova-compute[73029]:   <uuid>b674e3df-c413-4306-b3cf-8f872abee7fe</uuid>
Aug 10 01:19:17 user nova-compute[73029]:   <name>instance-00000027</name>
Aug 10 01:19:17 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:19:17 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:19:17 user nova-compute[73029]:   <metadata>
Aug 10 01:19:17 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:19:17 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:19:17 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeTestJSON-server-776952036</nova:name>
Aug 10 01:19:17 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:19:17</nova:creationTime>
Aug 10 01:19:17 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:19:17 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:19:17 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:19:17 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:19:17 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:19:17 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:19:17 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:19:17 user nova-compute[73029]:       <nova:owner>
Aug 10 01:19:17 user nova-compute[73029]:         <nova:user uuid="b8ab867cd18c4fbfb8c38f2d4666be8e">tempest-AttachVolumeTestJSON-1442739203-project-member</nova:user>
Aug 10 01:19:17 user nova-compute[73029]:         <nova:project uuid="27575d6efb9a45b2b9b38f2bbed286ec">tempest-AttachVolumeTestJSON-1442739203</nova:project>
Aug 10 01:19:17 user nova-compute[73029]:       </nova:owner>
Aug 10 01:19:17 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:19:17 user nova-compute[73029]:       <nova:ports>
Aug 10 01:19:17 user nova-compute[73029]:         <nova:port uuid="a802fdef-f355-4ad7-8d8c-8bc5982152fa">
Aug 10 01:19:17 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 10 01:19:17 user nova-compute[73029]:         </nova:port>
Aug 10 01:19:17 user nova-compute[73029]:       </nova:ports>
Aug 10 01:19:17 user nova-compute[73029]:     </nova:instance>
Aug 10 01:19:17 user nova-compute[73029]:   </metadata>
Aug 10 01:19:17 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:19:17 user nova-compute[73029]:     <system>
Aug 10 01:19:17 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:19:17 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:19:17 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:19:17 user nova-compute[73029]:       <entry name="serial">b674e3df-c413-4306-b3cf-8f872abee7fe</entry>
Aug 10 01:19:17 user nova-compute[73029]:       <entry name="uuid">b674e3df-c413-4306-b3cf-8f872abee7fe</entry>
Aug 10 01:19:17 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:19:17 user nova-compute[73029]:     </system>
Aug 10 01:19:17 user nova-compute[73029]:   </sysinfo>
Aug 10 01:19:17 user nova-compute[73029]:   <os>
Aug 10 01:19:17 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:19:17 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:19:17 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:19:17 user nova-compute[73029]:   </os>
Aug 10 01:19:17 user nova-compute[73029]:   <features>
Aug 10 01:19:17 user nova-compute[73029]:     <acpi/>
Aug 10 01:19:17 user nova-compute[73029]:     <apic/>
Aug 10 01:19:17 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:19:17 user nova-compute[73029]:   </features>
Aug 10 01:19:17 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:19:17 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:19:17 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:19:17 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:19:17 user nova-compute[73029]:   </clock>
Aug 10 01:19:17 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:19:17 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:19:17 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:19:17 user nova-compute[73029]:   </cpu>
Aug 10 01:19:17 user nova-compute[73029]:   <devices>
Aug 10 01:19:17 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:19:17 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:19:17 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk"/>
Aug 10 01:19:17 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:19:17 user nova-compute[73029]:     </disk>
Aug 10 01:19:17 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:19:17 user nova-compute[73029]:       <mac address="fa:16:3e:85:e4:bc"/>
Aug 10 01:19:17 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:19:17 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:19:17 user nova-compute[73029]:       <target dev="tapa802fdef-f3"/>
Aug 10 01:19:17 user nova-compute[73029]:     </interface>
Aug 10 01:19:17 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:19:17 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/console.log" append="off"/>
Aug 10 01:19:17 user nova-compute[73029]:     </serial>
Aug 10 01:19:17 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:19:17 user nova-compute[73029]:     <video>
Aug 10 01:19:17 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:19:17 user nova-compute[73029]:     </video>
Aug 10 01:19:17 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:19:17 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:19:17 user nova-compute[73029]:     </rng>
Aug 10 01:19:17 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:19:17 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:19:17 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:19:17 user nova-compute[73029]:     </memballoon>
Aug 10 01:19:17 user nova-compute[73029]:   </devices>
Aug 10 01:19:17 user nova-compute[73029]: </domain>
Aug 10 01:19:17 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'trusted_certs' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Cannot resize image /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'migration_context' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776952036',display_name='tempest-AttachVolumeTestJSON-server-776952036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776952036',id=39,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAKK0VG3VaK5fUTIrsIMgv2KdcKIveiKEuYPJ3NPT6NMJIrLKchH0nOOACYfezLlyV+Jwy2xpwEI2ExcJ8Dbxy7zTcu6IqOZv7ilbVXlr1d2IPY0JmgEfup+rNLgIEoxA==',key_name='tempest-keypair-986600418',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-3wyvwgei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=b674e3df-c413-4306-b3cf-8f872abee7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG os_vif [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa802fdef-f3, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa802fdef-f3, col_values=(('external_ids', {'iface-id': 'a802fdef-f355-4ad7-8d8c-8bc5982152fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:e4:bc', 'vm-uuid': 'b674e3df-c413-4306-b3cf-8f872abee7fe'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:17 user nova-compute[73029]: INFO os_vif [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3')
Aug 10 01:19:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-952cd2a6-dcba-4d46-95d3-1fe63e251bd6 req-0729dcec-307d-4366-83d1-8a1c608b7266 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-952cd2a6-dcba-4d46-95d3-1fe63e251bd6 req-0729dcec-307d-4366-83d1-8a1c608b7266 service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-952cd2a6-dcba-4d46-95d3-1fe63e251bd6 req-0729dcec-307d-4366-83d1-8a1c608b7266 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-952cd2a6-dcba-4d46-95d3-1fe63e251bd6 req-0729dcec-307d-4366-83d1-8a1c608b7266 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-952cd2a6-dcba-4d46-95d3-1fe63e251bd6 req-0729dcec-307d-4366-83d1-8a1c608b7266 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:19:19 user nova-compute[73029]: WARNING nova.compute.manager [req-952cd2a6-dcba-4d46-95d3-1fe63e251bd6 req-0729dcec-307d-4366-83d1-8a1c608b7266 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state stopped and task_state powering-on.
Aug 10 01:19:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630361.1071696, b674e3df-c413-4306-b3cf-8f872abee7fe => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:19:21 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] VM Resumed (Lifecycle Event)
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:19:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance rebooted successfully.
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-04321be8-391c-4a7f-aa56-fca2bb7096e9 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:19:21 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630361.1114242, b674e3df-c413-4306-b3cf-8f872abee7fe => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:19:21 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] VM Started (Lifecycle Event)
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-cbfe61fc-53cb-4bad-ae0b-ad5f3bd04637 req-356ef693-fc7b-44e1-a0b3-c4e2edeb33ba service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:19:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cbfe61fc-53cb-4bad-ae0b-ad5f3bd04637 req-356ef693-fc7b-44e1-a0b3-c4e2edeb33ba service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:19:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cbfe61fc-53cb-4bad-ae0b-ad5f3bd04637 req-356ef693-fc7b-44e1-a0b3-c4e2edeb33ba service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:19:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cbfe61fc-53cb-4bad-ae0b-ad5f3bd04637 req-356ef693-fc7b-44e1-a0b3-c4e2edeb33ba service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:19:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-cbfe61fc-53cb-4bad-ae0b-ad5f3bd04637 req-356ef693-fc7b-44e1-a0b3-c4e2edeb33ba service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:19:21 user nova-compute[73029]: WARNING nova.compute.manager [req-cbfe61fc-53cb-4bad-ae0b-ad5f3bd04637 req-356ef693-fc7b-44e1-a0b3-c4e2edeb33ba service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state active and task_state None.
Aug 10 01:19:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-c1f00ebc-2109-4d76-bdc4-bf6592b1544f req-b4a10849-347e-40a4-b6b2-cc498c6db0a0 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received event network-changed-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:19:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-c1f00ebc-2109-4d76-bdc4-bf6592b1544f req-b4a10849-347e-40a4-b6b2-cc498c6db0a0 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Refreshing instance network info cache due to event network-changed-e8b05472-c8b0-4943-99fd-7772e2fcb5bd. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:19:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c1f00ebc-2109-4d76-bdc4-bf6592b1544f req-b4a10849-347e-40a4-b6b2-cc498c6db0a0 service nova] Acquiring lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:19:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c1f00ebc-2109-4d76-bdc4-bf6592b1544f req-b4a10849-347e-40a4-b6b2-cc498c6db0a0 service nova] Acquired lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:19:39 user nova-compute[73029]: DEBUG nova.network.neutron [req-c1f00ebc-2109-4d76-bdc4-bf6592b1544f req-b4a10849-347e-40a4-b6b2-cc498c6db0a0 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Refreshing network info cache for port e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:19:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:19:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:19:39 user nova-compute[73029]: DEBUG nova.objects.instance [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'flavor' on Instance uuid 3f08b34f-17b9-4657-9df0-783a74af5d5a {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:39 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Ignoring supplied device name: /dev/vdb
Aug 10 01:19:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:19:40 user nova-compute[73029]: INFO nova.compute.manager [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Attaching volume 08b57f70-a61a-4925-8a1e-894c2261a8e5 to /dev/vdb
Aug 10 01:19:40 user nova-compute[73029]: DEBUG nova.network.neutron [req-c1f00ebc-2109-4d76-bdc4-bf6592b1544f req-b4a10849-347e-40a4-b6b2-cc498c6db0a0 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Updated VIF entry in instance network info cache for port e8b05472-c8b0-4943-99fd-7772e2fcb5bd. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG nova.network.neutron [req-c1f00ebc-2109-4d76-bdc4-bf6592b1544f req-b4a10849-347e-40a4-b6b2-cc498c6db0a0 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Updating instance_info_cache with network_info: [{"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG os_brick.utils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c1f00ebc-2109-4d76-bdc4-bf6592b1544f req-b4a10849-347e-40a4-b6b2-cc498c6db0a0 service nova] Releasing lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eece12e-19ae-42d1-aac9-9e605145bdbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b79928c-fcdd-447f-a273-ad7e4707e708]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[30be7668-adb3-4848-8ffb-63a28c087c8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[983d0a6b-0879-46a6-8d0c-56d397e83985]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:19:40 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:19:40 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274cb62-34b1-4388-9d08-da10e9a90276]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG os_brick.utils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:19:40 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Updating existing volume attachment record: eedc1e5e-40d1-476c-b64d-2049e2f23a1a {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:19:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:47 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:19:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHpwXBmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:19:48 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:19:48 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:19:48 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe87a01-cc65-4e92-88c0-fee969aaece9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:19:48 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de89523-cbdf-4572-ac2b-80fecee08fe4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5] added
Aug 10 01:19:48 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cad311-c59d-463b-aecd-7d04edd3555b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f0742b-a320-47c7-a77f-71024cb3160b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHpwXBmc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHpwXBmc" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2431a2-5762-40b8-985d-4d7b5d11a8bc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHpwXBmc'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8279d48f-0a4c-4336-ba90-6e4886f624b3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a7ffc7-2a71-4f76-940f-5cf3015a98ee]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:19:48 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:19:48 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:19:48 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:19:48 user nova-compute[73029]: 
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90c586-3ad6-42a2-8769-ef5e18c631cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5, portal: 172.16.0.220,3260]
Aug 10 01:19:48 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5, portal: 172.16.0.220,3260] successful.
Aug 10 01:19:48 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a8ae9a-0df4-4ccf-a627-4ad9080f6a47]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b744a847-55d9-4ebe-8ffd-9bfed28ffd4e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 (non-flash)
Aug 10 01:19:48 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 (non-flash)
Aug 10 01:19:48 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabb3f78-e737-47ed-8dd1-e40e51673ede]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:19:48 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:19:49 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:19:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHpwXBmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:19:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:19:49 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23634353033343861', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:19:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634353033343861', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:19:49 user nova-compute[73029]: DEBUG nova.objects.instance [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'flavor' on Instance uuid 3f08b34f-17b9-4657-9df0-783a74af5d5a {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:19:49 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:19:49 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:19:49 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:19:49 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:19:49 user nova-compute[73029]:   <serial>08b57f70-a61a-4925-8a1e-894c2261a8e5</serial>
Aug 10 01:19:49 user nova-compute[73029]: </disk>
Aug 10 01:19:49 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:19:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:19:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:19:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No VIF found with MAC fa:16:3e:01:ed:9c, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:19:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-73ec93eb-7483-4019-864d-653c781e38cd tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.384s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:19:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:19:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:19:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:19:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:19:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:19:54 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:19:54 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Updating instance_info_cache with network_info: [{"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:19:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-3f08b34f-17b9-4657-9df0-783a74af5d5a" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:19:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:19:55 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:19:57 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:19:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:19:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:19:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=25.065120697021484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 3f08b34f-17b9-4657-9df0-783a74af5d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:19:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:19:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:19:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:19:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:20:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:20:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:20:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:20:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:20:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:20:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:20:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:20:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:20:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:20:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:20:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:20:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:20:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:20:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:20:24 user nova-compute[73029]: INFO nova.compute.manager [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Detaching volume 08b57f70-a61a-4925-8a1e-894c2261a8e5
Aug 10 01:20:24 user nova-compute[73029]: INFO nova.virt.block_device [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Attempting to driver detach volume 08b57f70-a61a-4925-8a1e-894c2261a8e5 from mountpoint /dev/vdb
Aug 10 01:20:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Attempting to detach device vdb from instance 3f08b34f-17b9-4657-9df0-783a74af5d5a from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:20:24 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:20:24 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:20:24 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:20:24 user nova-compute[73029]:   <serial>08b57f70-a61a-4925-8a1e-894c2261a8e5</serial>
Aug 10 01:20:24 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:20:24 user nova-compute[73029]: </disk>
Aug 10 01:20:24 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:20:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Successfully detached device vdb from instance 3f08b34f-17b9-4657-9df0-783a74af5d5a from the persistent domain config.
Aug 10 01:20:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f08b34f-17b9-4657-9df0-783a74af5d5a from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:20:24 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:20:24 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:20:24 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:20:24 user nova-compute[73029]:   <serial>08b57f70-a61a-4925-8a1e-894c2261a8e5</serial>
Aug 10 01:20:24 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:20:24 user nova-compute[73029]: </disk>
Aug 10 01:20:24 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691630424.5381277, 3f08b34f-17b9-4657-9df0-783a74af5d5a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f08b34f-17b9-4657-9df0-783a74af5d5a {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:20:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Successfully detached device vdb from instance 3f08b34f-17b9-4657-9df0-783a74af5d5a from the live domain config.
Aug 10 01:20:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHpwXBmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:20:24 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38340d1-5fb3-46f1-9806-7de7440c770b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd385c3-e8eb-43db-adb6-01653fa28df0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 (non-flash)
Aug 10 01:20:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 (non-flash)
Aug 10 01:20:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7514269a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e395dc-0050-42b4-b2ae-92cd01398096]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5961f-3488-47e3-afbf-981f549768e0]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f6b92b-2ad9-48af-a8e6-40468ab29f8c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[634d80d4-6754-4efd-892a-be195fc0e2be]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[19618d83-a1b0-4155-9bbb-fcc2cc537c65]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3069f5-6ad6-47ef-951e-f35652d56a0d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5, portal: 172.16.0.220,3260]
Aug 10 01:20:24 user nova-compute[73029]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5, portal: 172.16.0.220,3260] successful.
Aug 10 01:20:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafd4a2b-8ffa-4800-aaf9-a56ad6320f1f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] <== disconnect_volume: return (285ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:20:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'flavor' on Instance uuid 3f08b34f-17b9-4657-9df0-783a74af5d5a {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5a08ea85-fd9d-478f-862a-aaf6d94ad823 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.492s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:20:25 user nova-compute[73029]: INFO nova.compute.manager [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Terminating instance
Aug 10 01:20:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-b4cac57c-e87b-485a-9e0f-7a539a926274 req-12e2cd80-a623-4e52-b640-e97bb3210803 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received event network-vif-unplugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b4cac57c-e87b-485a-9e0f-7a539a926274 req-12e2cd80-a623-4e52-b640-e97bb3210803 service nova] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b4cac57c-e87b-485a-9e0f-7a539a926274 req-12e2cd80-a623-4e52-b640-e97bb3210803 service nova] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b4cac57c-e87b-485a-9e0f-7a539a926274 req-12e2cd80-a623-4e52-b640-e97bb3210803 service nova] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-b4cac57c-e87b-485a-9e0f-7a539a926274 req-12e2cd80-a623-4e52-b640-e97bb3210803 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] No waiting events found dispatching network-vif-unplugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:20:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-b4cac57c-e87b-485a-9e0f-7a539a926274 req-12e2cd80-a623-4e52-b640-e97bb3210803 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received event network-vif-unplugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Instance destroyed successfully.
Aug 10 01:20:26 user nova-compute[73029]: DEBUG nova.objects.instance [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'resources' on Instance uuid 3f08b34f-17b9-4657-9df0-783a74af5d5a {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-186580580',display_name='tempest-VolumesSnapshotTestJSON-instance-186580580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-186580580',id=40,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIriOwJPLMNRejpoHrEs8qL/Tmz0Kux4+9iUL6PLcNJAx+p7sdOaMOQ6N4arIoqROcGlwPjim55QIV/ztn/FJWlRKpjR4ES4GlGPV3RHEw7UidE+ONJa+xMpK1wIHTkeYw==',key_name='tempest-keypair-83917566',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:17:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7bda2c5abe742c6af24393e22e87321',ramdisk_id='',reservation_id='r-sdfl70vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1971863414',owner_user_name='tempest-VolumesSnapshotTestJSON-1971863414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2bf5ce780542cca24b37e3f929dc32',uuid=3f08b34f-17b9-4657-9df0-783a74af5d5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converting VIF {"id": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "address": "fa:16:3e:01:ed:9c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b05472-c8", "ovs_interfaceid": "e8b05472-c8b0-4943-99fd-7772e2fcb5bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=e8b05472-c8b0-4943-99fd-7772e2fcb5bd,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b05472-c8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_vif [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=e8b05472-c8b0-4943-99fd-7772e2fcb5bd,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b05472-c8') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8b05472-c8, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:20:26 user nova-compute[73029]: INFO os_vif [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=e8b05472-c8b0-4943-99fd-7772e2fcb5bd,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b05472-c8')
Aug 10 01:20:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHpwXBmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:20:26 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08b57f70-a61a-4925-8a1e-894c2261a8e5', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[56256cba-ed6b-481b-a2f2-2d350d3845a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:26 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 10 01:20:26 user nova-compute[73029]: 
Aug 10 01:20:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1865970-468f-408f-a6e4-b1d409ce85da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:20:26 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:20:26 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:20:26 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:20:26 user nova-compute[73029]: 
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751c0dfa30>, {}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Disconnecting from: [] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] <== disconnect_volume: return (42ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:20:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Deleting instance files /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a_del
Aug 10 01:20:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Deletion of /opt/stack/data/nova/instances/3f08b34f-17b9-4657-9df0-783a74af5d5a_del complete
Aug 10 01:20:26 user nova-compute[73029]: INFO nova.compute.manager [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 10 01:20:26 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:20:26 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-357e5c98-1fab-458f-a066-980ae553b781 req-f41d76c4-0884-4a01-8200-e07d2a8204bf service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received event network-vif-plugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-357e5c98-1fab-458f-a066-980ae553b781 req-f41d76c4-0884-4a01-8200-e07d2a8204bf service nova] Acquiring lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-357e5c98-1fab-458f-a066-980ae553b781 req-f41d76c4-0884-4a01-8200-e07d2a8204bf service nova] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-357e5c98-1fab-458f-a066-980ae553b781 req-f41d76c4-0884-4a01-8200-e07d2a8204bf service nova] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-357e5c98-1fab-458f-a066-980ae553b781 req-f41d76c4-0884-4a01-8200-e07d2a8204bf service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] No waiting events found dispatching network-vif-plugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:20:28 user nova-compute[73029]: WARNING nova.compute.manager [req-357e5c98-1fab-458f-a066-980ae553b781 req-f41d76c4-0884-4a01-8200-e07d2a8204bf service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received unexpected event network-vif-plugged-e8b05472-c8b0-4943-99fd-7772e2fcb5bd for instance with vm_state active and task_state deleting.
Aug 10 01:20:28 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:20:28 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Took 1.53 seconds to deallocate network for instance.
Aug 10 01:20:28 user nova-compute[73029]: WARNING nova.volume.cinder [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Attachment eedc1e5e-40d1-476c-b64d-2049e2f23a1a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = eedc1e5e-40d1-476c-b64d-2049e2f23a1a. (HTTP 404) (Request-ID: req-970393a4-ceb8-4708-ab8b-c33edeb6222a)
Aug 10 01:20:28 user nova-compute[73029]: INFO nova.compute.manager [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Took 0.03 seconds to detach 1 volumes for instance.
Aug 10 01:20:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-42cbca16-2c57-424f-87dd-e8a9265c235d req-96c2fe1e-91c4-462b-84e2-67077ffb55b4 service nova] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Received event network-vif-deleted-e8b05472-c8b0-4943-99fd-7772e2fcb5bd {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:20:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:20:28 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Deleted allocations for instance 3f08b34f-17b9-4657-9df0-783a74af5d5a
Aug 10 01:20:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-9ac16847-bd71-4e95-a1af-9cdbc6cf0c92 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "3f08b34f-17b9-4657-9df0-783a74af5d5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.799s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:20:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:41 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691630426.3718803, 3f08b34f-17b9-4657-9df0-783a74af5d5a => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:20:41 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] VM Stopped (Lifecycle Event)
Aug 10 01:20:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-9b3d09b6-9da1-408a-af55-c5ec875bb8c9 None None] [instance: 3f08b34f-17b9-4657-9df0-783a74af5d5a] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:20:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:49 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [{"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-b674e3df-c413-4306-b3cf-8f872abee7fe" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:20:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:20:57 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:20:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:20:58 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:20:58 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.091941833496094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:20:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:20:59 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance b674e3df-c413-4306-b3cf-8f872abee7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:20:59 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:20:59 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:20:59 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:20:59 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:20:59 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:20:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:21:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:21:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:07 user nova-compute[73029]: INFO nova.compute.manager [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Terminating instance
Aug 10 01:21:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG nova.compute.manager [req-08178150-f439-46d9-a53a-fac7f4dd62fb req-6f457ef2-45fc-4418-877e-5fb38164209a service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-unplugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-08178150-f439-46d9-a53a-fac7f4dd62fb req-6f457ef2-45fc-4418-877e-5fb38164209a service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-08178150-f439-46d9-a53a-fac7f4dd62fb req-6f457ef2-45fc-4418-877e-5fb38164209a service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-08178150-f439-46d9-a53a-fac7f4dd62fb req-6f457ef2-45fc-4418-877e-5fb38164209a service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG nova.compute.manager [req-08178150-f439-46d9-a53a-fac7f4dd62fb req-6f457ef2-45fc-4418-877e-5fb38164209a service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-unplugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:21:07 user nova-compute[73029]: DEBUG nova.compute.manager [req-08178150-f439-46d9-a53a-fac7f4dd62fb req-6f457ef2-45fc-4418-877e-5fb38164209a service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-unplugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:08 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Instance destroyed successfully.
Aug 10 01:21:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'resources' on Instance uuid b674e3df-c413-4306-b3cf-8f872abee7fe {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776952036',display_name='tempest-AttachVolumeTestJSON-server-776952036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776952036',id=39,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAKK0VG3VaK5fUTIrsIMgv2KdcKIveiKEuYPJ3NPT6NMJIrLKchH0nOOACYfezLlyV+Jwy2xpwEI2ExcJ8Dbxy7zTcu6IqOZv7ilbVXlr1d2IPY0JmgEfup+rNLgIEoxA==',key_name='tempest-keypair-986600418',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-3wyvwgei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=b674e3df-c413-4306-b3cf-8f872abee7fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "address": "fa:16:3e:85:e4:bc", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa802fdef-f3", "ovs_interfaceid": "a802fdef-f355-4ad7-8d8c-8bc5982152fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG os_vif [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa802fdef-f3, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:21:08 user nova-compute[73029]: INFO os_vif [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=a802fdef-f355-4ad7-8d8c-8bc5982152fa,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa802fdef-f3')
Aug 10 01:21:08 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Deleting instance files /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe_del
Aug 10 01:21:08 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Deletion of /opt/stack/data/nova/instances/b674e3df-c413-4306-b3cf-8f872abee7fe_del complete
Aug 10 01:21:08 user nova-compute[73029]: INFO nova.compute.manager [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 10 01:21:08 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:21:08 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:21:09 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Took 0.77 seconds to deallocate network for instance.
Aug 10 01:21:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-d8f8159b-f728-42a5-91fd-89a703a52652 req-9e5f4e43-4032-4615-be46-592a71ec6ab7 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-deleted-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:09 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Deleted allocations for instance b674e3df-c413-4306-b3cf-8f872abee7fe
Aug 10 01:21:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2b58e38a-c37c-49ed-bc4d-22e52783da06 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-125ea5d1-46f9-4bfb-b511-0933b739ba54 req-542b98c4-2afd-4ca8-8d41-0eb6649b42a3 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-125ea5d1-46f9-4bfb-b511-0933b739ba54 req-542b98c4-2afd-4ca8-8d41-0eb6649b42a3 service nova] Acquiring lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-125ea5d1-46f9-4bfb-b511-0933b739ba54 req-542b98c4-2afd-4ca8-8d41-0eb6649b42a3 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-125ea5d1-46f9-4bfb-b511-0933b739ba54 req-542b98c4-2afd-4ca8-8d41-0eb6649b42a3 service nova] Lock "b674e3df-c413-4306-b3cf-8f872abee7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-125ea5d1-46f9-4bfb-b511-0933b739ba54 req-542b98c4-2afd-4ca8-8d41-0eb6649b42a3 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] No waiting events found dispatching network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:21:09 user nova-compute[73029]: WARNING nova.compute.manager [req-125ea5d1-46f9-4bfb-b511-0933b739ba54 req-542b98c4-2afd-4ca8-8d41-0eb6649b42a3 service nova] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Received unexpected event network-vif-plugged-a802fdef-f355-4ad7-8d8c-8bc5982152fa for instance with vm_state deleted and task_state None.
Aug 10 01:21:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:23 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691630468.367473, b674e3df-c413-4306-b3cf-8f872abee7fe => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:21:23 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] VM Stopped (Lifecycle Event)
Aug 10 01:21:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-18fa9d80-c194-483d-8de7-18c73e0ab0d7 None None] [instance: b674e3df-c413-4306-b3cf-8f872abee7fe] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:21:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:21:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:21:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:21:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:21:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:21:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:21:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:21:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:40 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:21:40 user nova-compute[73029]: INFO nova.compute.claims [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Claim successful on node user
Aug 10 01:21:40 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:21:40 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:21:40 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.network.neutron [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:21:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.policy [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb2bf5ce780542cca24b37e3f929dc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bda2c5abe742c6af24393e22e87321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:21:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Creating image(s)
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "/opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "/opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "/opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.178s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.153s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk 1073741824" returned: 0 in 0.054s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.163s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.network.neutron [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Successfully created port: 1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Cannot resize image /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.objects.instance [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'migration_context' on Instance uuid 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Ensure instance console log exists: /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:42 user nova-compute[73029]: DEBUG nova.network.neutron [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Successfully updated port: 1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:21:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:21:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquired lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:21:42 user nova-compute[73029]: DEBUG nova.network.neutron [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:21:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-f8508b76-155d-47ff-bcf8-78754904dd6d req-43d76d26-aba4-4825-b339-1ed382694a4e service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received event network-changed-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:21:42 user nova-compute[73029]: DEBUG nova.compute.manager [req-f8508b76-155d-47ff-bcf8-78754904dd6d req-43d76d26-aba4-4825-b339-1ed382694a4e service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Refreshing instance network info cache due to event network-changed-1beccb06-baa7-4cd5-aaa9-dbed80459ef5. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:21:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f8508b76-155d-47ff-bcf8-78754904dd6d req-43d76d26-aba4-4825-b339-1ed382694a4e service nova] Acquiring lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:21:42 user nova-compute[73029]: DEBUG nova.network.neutron [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:21:42 user nova-compute[73029]: DEBUG nova.network.neutron [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updating instance_info_cache with network_info: [{"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Releasing lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Instance network_info: |[{"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f8508b76-155d-47ff-bcf8-78754904dd6d req-43d76d26-aba4-4825-b339-1ed382694a4e service nova] Acquired lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.network.neutron [req-f8508b76-155d-47ff-bcf8-78754904dd6d req-43d76d26-aba4-4825-b339-1ed382694a4e service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Refreshing network info cache for port 1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Start _get_guest_xml network_info=[{"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:21:43 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:21:43 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-494535847',display_name='tempest-VolumesSnapshotTestJSON-instance-494535847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-494535847',id=41,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg8i0GP/q5nhDrt5herh/aaJeezQLWFVlQ9ZtZMV31NFWlCUkj2yu1xLlArSXZyaJ4kfaoWkHF4Ygf3GK6kBRl1Z7mDs22n46FK58WGQV4wh3Wwi+RT+6Bvfbe1IUUWTg==',key_name='tempest-keypair-685177842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bda2c5abe742c6af24393e22e87321',ramdisk_id='',reservation_id='r-snkpl0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1971863414',owner_user_name='tempest-VolumesSnapshotTestJSON-1971863414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2bf5ce780542cca24b37e3f929dc32',uuid=64703aae-93b4-4173-80c8-7e39ab9cd667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converting VIF {"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:8c,bridge_name='br-int',has_traffic_filtering=True,id=1beccb06-baa7-4cd5-aaa9-dbed80459ef5,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beccb06-ba') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.objects.instance [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'pci_devices' on Instance uuid 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:21:43 user nova-compute[73029]:   <uuid>64703aae-93b4-4173-80c8-7e39ab9cd667</uuid>
Aug 10 01:21:43 user nova-compute[73029]:   <name>instance-00000029</name>
Aug 10 01:21:43 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:21:43 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:21:43 user nova-compute[73029]:   <metadata>
Aug 10 01:21:43 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:21:43 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:21:43 user nova-compute[73029]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-494535847</nova:name>
Aug 10 01:21:43 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:21:43</nova:creationTime>
Aug 10 01:21:43 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:21:43 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:21:43 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:21:43 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:21:43 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:21:43 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:21:43 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:21:43 user nova-compute[73029]:       <nova:owner>
Aug 10 01:21:43 user nova-compute[73029]:         <nova:user uuid="cb2bf5ce780542cca24b37e3f929dc32">tempest-VolumesSnapshotTestJSON-1971863414-project-member</nova:user>
Aug 10 01:21:43 user nova-compute[73029]:         <nova:project uuid="b7bda2c5abe742c6af24393e22e87321">tempest-VolumesSnapshotTestJSON-1971863414</nova:project>
Aug 10 01:21:43 user nova-compute[73029]:       </nova:owner>
Aug 10 01:21:43 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:21:43 user nova-compute[73029]:       <nova:ports>
Aug 10 01:21:43 user nova-compute[73029]:         <nova:port uuid="1beccb06-baa7-4cd5-aaa9-dbed80459ef5">
Aug 10 01:21:43 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 10 01:21:43 user nova-compute[73029]:         </nova:port>
Aug 10 01:21:43 user nova-compute[73029]:       </nova:ports>
Aug 10 01:21:43 user nova-compute[73029]:     </nova:instance>
Aug 10 01:21:43 user nova-compute[73029]:   </metadata>
Aug 10 01:21:43 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:21:43 user nova-compute[73029]:     <system>
Aug 10 01:21:43 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:21:43 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:21:43 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:21:43 user nova-compute[73029]:       <entry name="serial">64703aae-93b4-4173-80c8-7e39ab9cd667</entry>
Aug 10 01:21:43 user nova-compute[73029]:       <entry name="uuid">64703aae-93b4-4173-80c8-7e39ab9cd667</entry>
Aug 10 01:21:43 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:21:43 user nova-compute[73029]:     </system>
Aug 10 01:21:43 user nova-compute[73029]:   </sysinfo>
Aug 10 01:21:43 user nova-compute[73029]:   <os>
Aug 10 01:21:43 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:21:43 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:21:43 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:21:43 user nova-compute[73029]:   </os>
Aug 10 01:21:43 user nova-compute[73029]:   <features>
Aug 10 01:21:43 user nova-compute[73029]:     <acpi/>
Aug 10 01:21:43 user nova-compute[73029]:     <apic/>
Aug 10 01:21:43 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:21:43 user nova-compute[73029]:   </features>
Aug 10 01:21:43 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:21:43 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:21:43 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:21:43 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:21:43 user nova-compute[73029]:   </clock>
Aug 10 01:21:43 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:21:43 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:21:43 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:21:43 user nova-compute[73029]:   </cpu>
Aug 10 01:21:43 user nova-compute[73029]:   <devices>
Aug 10 01:21:43 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:21:43 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:21:43 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk"/>
Aug 10 01:21:43 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:21:43 user nova-compute[73029]:     </disk>
Aug 10 01:21:43 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:21:43 user nova-compute[73029]:       <mac address="fa:16:3e:73:f5:8c"/>
Aug 10 01:21:43 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:21:43 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:21:43 user nova-compute[73029]:       <target dev="tap1beccb06-ba"/>
Aug 10 01:21:43 user nova-compute[73029]:     </interface>
Aug 10 01:21:43 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:21:43 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/console.log" append="off"/>
Aug 10 01:21:43 user nova-compute[73029]:     </serial>
Aug 10 01:21:43 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:21:43 user nova-compute[73029]:     <video>
Aug 10 01:21:43 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:21:43 user nova-compute[73029]:     </video>
Aug 10 01:21:43 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:21:43 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:21:43 user nova-compute[73029]:     </rng>
Aug 10 01:21:43 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:21:43 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:21:43 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:21:43 user nova-compute[73029]:     </memballoon>
Aug 10 01:21:43 user nova-compute[73029]:   </devices>
Aug 10 01:21:43 user nova-compute[73029]: </domain>
Aug 10 01:21:43 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-494535847',display_name='tempest-VolumesSnapshotTestJSON-instance-494535847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-494535847',id=41,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg8i0GP/q5nhDrt5herh/aaJeezQLWFVlQ9ZtZMV31NFWlCUkj2yu1xLlArSXZyaJ4kfaoWkHF4Ygf3GK6kBRl1Z7mDs22n46FK58WGQV4wh3Wwi+RT+6Bvfbe1IUUWTg==',key_name='tempest-keypair-685177842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bda2c5abe742c6af24393e22e87321',ramdisk_id='',reservation_id='r-snkpl0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1971863414',owner_user_name='tempest-VolumesSnapshotTestJSON-1971863414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2bf5ce780542cca24b37e3f929dc32',uuid=64703aae-93b4-4173-80c8-7e39ab9cd667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converting VIF {"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:8c,bridge_name='br-int',has_traffic_filtering=True,id=1beccb06-baa7-4cd5-aaa9-dbed80459ef5,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beccb06-ba') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG os_vif [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:8c,bridge_name='br-int',has_traffic_filtering=True,id=1beccb06-baa7-4cd5-aaa9-dbed80459ef5,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beccb06-ba') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1beccb06-ba, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1beccb06-ba, col_values=(('external_ids', {'iface-id': '1beccb06-baa7-4cd5-aaa9-dbed80459ef5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:f5:8c', 'vm-uuid': '64703aae-93b4-4173-80c8-7e39ab9cd667'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:43 user nova-compute[73029]: INFO os_vif [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:8c,bridge_name='br-int',has_traffic_filtering=True,id=1beccb06-baa7-4cd5-aaa9-dbed80459ef5,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beccb06-ba')
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No VIF found with MAC fa:16:3e:73:f5:8c, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.network.neutron [req-f8508b76-155d-47ff-bcf8-78754904dd6d req-43d76d26-aba4-4825-b339-1ed382694a4e service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updated VIF entry in instance network info cache for port 1beccb06-baa7-4cd5-aaa9-dbed80459ef5. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG nova.network.neutron [req-f8508b76-155d-47ff-bcf8-78754904dd6d req-43d76d26-aba4-4825-b339-1ed382694a4e service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updating instance_info_cache with network_info: [{"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:21:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f8508b76-155d-47ff-bcf8-78754904dd6d req-43d76d26-aba4-4825-b339-1ed382694a4e service nova] Releasing lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:21:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-e3e770a3-9d43-4337-9336-5b61496ed530 req-0a96c468-d94f-46f1-abe1-cfbf5476c9ac service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received event network-vif-plugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:21:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e3e770a3-9d43-4337-9336-5b61496ed530 req-0a96c468-d94f-46f1-abe1-cfbf5476c9ac service nova] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e3e770a3-9d43-4337-9336-5b61496ed530 req-0a96c468-d94f-46f1-abe1-cfbf5476c9ac service nova] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e3e770a3-9d43-4337-9336-5b61496ed530 req-0a96c468-d94f-46f1-abe1-cfbf5476c9ac service nova] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-e3e770a3-9d43-4337-9336-5b61496ed530 req-0a96c468-d94f-46f1-abe1-cfbf5476c9ac service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] No waiting events found dispatching network-vif-plugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:21:44 user nova-compute[73029]: WARNING nova.compute.manager [req-e3e770a3-9d43-4337-9336-5b61496ed530 req-0a96c468-d94f-46f1-abe1-cfbf5476c9ac service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received unexpected event network-vif-plugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 for instance with vm_state building and task_state spawning.
Aug 10 01:21:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630506.5183752, 64703aae-93b4-4173-80c8-7e39ab9cd667 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:21:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] VM Resumed (Lifecycle Event)
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:21:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Instance spawned successfully.
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:21:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630506.5202162, 64703aae-93b4-4173-80c8-7e39ab9cd667 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:21:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] VM Started (Lifecycle Event)
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:21:46 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:21:46 user nova-compute[73029]: INFO nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:21:46 user nova-compute[73029]: INFO nova.compute.manager [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Took 5.97 seconds to build instance.
Aug 10 01:21:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-aa801339-9f3e-4cde-b7ca-a66b61502fac tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.073s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-e16f9c2f-a2d1-4c73-a043-02cb58629a17 req-fd17b9de-b7b4-4311-9559-62e4dd408e21 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received event network-vif-plugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e16f9c2f-a2d1-4c73-a043-02cb58629a17 req-fd17b9de-b7b4-4311-9559-62e4dd408e21 service nova] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e16f9c2f-a2d1-4c73-a043-02cb58629a17 req-fd17b9de-b7b4-4311-9559-62e4dd408e21 service nova] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e16f9c2f-a2d1-4c73-a043-02cb58629a17 req-fd17b9de-b7b4-4311-9559-62e4dd408e21 service nova] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-e16f9c2f-a2d1-4c73-a043-02cb58629a17 req-fd17b9de-b7b4-4311-9559-62e4dd408e21 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] No waiting events found dispatching network-vif-plugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:21:46 user nova-compute[73029]: WARNING nova.compute.manager [req-e16f9c2f-a2d1-4c73-a043-02cb58629a17 req-fd17b9de-b7b4-4311-9559-62e4dd408e21 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received unexpected event network-vif-plugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 for instance with vm_state active and task_state None.
Aug 10 01:21:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:51 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:21:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:55 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updating instance_info_cache with network_info: [{"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:21:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:21:58 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:21:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:21:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:21:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:21:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:21:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:21:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:21:59 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:21:59 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:21:59 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.109699249267578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:21:59 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 64703aae-93b4-4173-80c8-7e39ab9cd667 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:22:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:22:01 user nova-compute[73029]: INFO nova.compute.claims [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Claim successful on node user
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:22:01 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.policy [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ab867cd18c4fbfb8c38f2d4666be8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27575d6efb9a45b2b9b38f2bbed286ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:22:01 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Creating image(s)
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "/opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "/opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk 1073741824" returned: 0 in 0.049s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:22:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.152s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Successfully created port: 3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Cannot resize image /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG nova.objects.instance [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'migration_context' on Instance uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Ensure instance console log exists: /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:22:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Successfully updated port: 3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquired lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.compute.manager [req-0288194b-729f-48f5-ba57-43eb4ea235af req-3fbcb81f-e190-4f1e-a02c-68f83b5483eb service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received event network-changed-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.compute.manager [req-0288194b-729f-48f5-ba57-43eb4ea235af req-3fbcb81f-e190-4f1e-a02c-68f83b5483eb service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Refreshing instance network info cache due to event network-changed-3dd72077-c3fa-46cb-a1c4-94d45363d166. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0288194b-729f-48f5-ba57-43eb4ea235af req-3fbcb81f-e190-4f1e-a02c-68f83b5483eb service nova] Acquiring lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.network.neutron [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updating instance_info_cache with network_info: [{"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Releasing lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Instance network_info: |[{"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0288194b-729f-48f5-ba57-43eb4ea235af req-3fbcb81f-e190-4f1e-a02c-68f83b5483eb service nova] Acquired lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.network.neutron [req-0288194b-729f-48f5-ba57-43eb4ea235af req-3fbcb81f-e190-4f1e-a02c-68f83b5483eb service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Refreshing network info cache for port 3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Start _get_guest_xml network_info=[{"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:22:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:22:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-242367032',display_name='tempest-AttachVolumeTestJSON-server-242367032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-242367032',id=42,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOkH3PyxgZvqzTv+KK41sPKbENghQWaDkZCtbfY1hSQ8HH7kULjcu5T7lj1mIkvIA7ubp+i2LdLq5syIwoUJmmHuebOt8xizx+g/o6k8kInov7X7cjmfv7Kn+Zd/hC6CA==',key_name='tempest-keypair-273713983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-cd3dh0e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=ca881c57-12a8-4cb9-9d07-6f839b158dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3dd72077-c3fa-46cb-a1c4-94d45363d166,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd72077-c3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.objects.instance [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'pci_devices' on Instance uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:22:03 user nova-compute[73029]:   <uuid>ca881c57-12a8-4cb9-9d07-6f839b158dc6</uuid>
Aug 10 01:22:03 user nova-compute[73029]:   <name>instance-0000002a</name>
Aug 10 01:22:03 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:22:03 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:22:03 user nova-compute[73029]:   <metadata>
Aug 10 01:22:03 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:22:03 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:22:03 user nova-compute[73029]:       <nova:name>tempest-AttachVolumeTestJSON-server-242367032</nova:name>
Aug 10 01:22:03 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:22:03</nova:creationTime>
Aug 10 01:22:03 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:22:03 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:22:03 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:22:03 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:22:03 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:22:03 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:22:03 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:22:03 user nova-compute[73029]:       <nova:owner>
Aug 10 01:22:03 user nova-compute[73029]:         <nova:user uuid="b8ab867cd18c4fbfb8c38f2d4666be8e">tempest-AttachVolumeTestJSON-1442739203-project-member</nova:user>
Aug 10 01:22:03 user nova-compute[73029]:         <nova:project uuid="27575d6efb9a45b2b9b38f2bbed286ec">tempest-AttachVolumeTestJSON-1442739203</nova:project>
Aug 10 01:22:03 user nova-compute[73029]:       </nova:owner>
Aug 10 01:22:03 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:22:03 user nova-compute[73029]:       <nova:ports>
Aug 10 01:22:03 user nova-compute[73029]:         <nova:port uuid="3dd72077-c3fa-46cb-a1c4-94d45363d166">
Aug 10 01:22:03 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 10 01:22:03 user nova-compute[73029]:         </nova:port>
Aug 10 01:22:03 user nova-compute[73029]:       </nova:ports>
Aug 10 01:22:03 user nova-compute[73029]:     </nova:instance>
Aug 10 01:22:03 user nova-compute[73029]:   </metadata>
Aug 10 01:22:03 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:22:03 user nova-compute[73029]:     <system>
Aug 10 01:22:03 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:22:03 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:22:03 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:22:03 user nova-compute[73029]:       <entry name="serial">ca881c57-12a8-4cb9-9d07-6f839b158dc6</entry>
Aug 10 01:22:03 user nova-compute[73029]:       <entry name="uuid">ca881c57-12a8-4cb9-9d07-6f839b158dc6</entry>
Aug 10 01:22:03 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:22:03 user nova-compute[73029]:     </system>
Aug 10 01:22:03 user nova-compute[73029]:   </sysinfo>
Aug 10 01:22:03 user nova-compute[73029]:   <os>
Aug 10 01:22:03 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:22:03 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:22:03 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:22:03 user nova-compute[73029]:   </os>
Aug 10 01:22:03 user nova-compute[73029]:   <features>
Aug 10 01:22:03 user nova-compute[73029]:     <acpi/>
Aug 10 01:22:03 user nova-compute[73029]:     <apic/>
Aug 10 01:22:03 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:22:03 user nova-compute[73029]:   </features>
Aug 10 01:22:03 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:22:03 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:22:03 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:22:03 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:22:03 user nova-compute[73029]:   </clock>
Aug 10 01:22:03 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:22:03 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:22:03 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:22:03 user nova-compute[73029]:   </cpu>
Aug 10 01:22:03 user nova-compute[73029]:   <devices>
Aug 10 01:22:03 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:22:03 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:22:03 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk"/>
Aug 10 01:22:03 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:22:03 user nova-compute[73029]:     </disk>
Aug 10 01:22:03 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:22:03 user nova-compute[73029]:       <mac address="fa:16:3e:01:1e:ef"/>
Aug 10 01:22:03 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:22:03 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:22:03 user nova-compute[73029]:       <target dev="tap3dd72077-c3"/>
Aug 10 01:22:03 user nova-compute[73029]:     </interface>
Aug 10 01:22:03 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:22:03 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/console.log" append="off"/>
Aug 10 01:22:03 user nova-compute[73029]:     </serial>
Aug 10 01:22:03 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:22:03 user nova-compute[73029]:     <video>
Aug 10 01:22:03 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:22:03 user nova-compute[73029]:     </video>
Aug 10 01:22:03 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:22:03 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:22:03 user nova-compute[73029]:     </rng>
Aug 10 01:22:03 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:22:03 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:22:03 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:22:03 user nova-compute[73029]:     </memballoon>
Aug 10 01:22:03 user nova-compute[73029]:   </devices>
Aug 10 01:22:03 user nova-compute[73029]: </domain>
Aug 10 01:22:03 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-242367032',display_name='tempest-AttachVolumeTestJSON-server-242367032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-242367032',id=42,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOkH3PyxgZvqzTv+KK41sPKbENghQWaDkZCtbfY1hSQ8HH7kULjcu5T7lj1mIkvIA7ubp+i2LdLq5syIwoUJmmHuebOt8xizx+g/o6k8kInov7X7cjmfv7Kn+Zd/hC6CA==',key_name='tempest-keypair-273713983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-cd3dh0e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=ca881c57-12a8-4cb9-9d07-6f839b158dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3dd72077-c3fa-46cb-a1c4-94d45363d166,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd72077-c3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG os_vif [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3dd72077-c3fa-46cb-a1c4-94d45363d166,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd72077-c3') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dd72077-c3, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3dd72077-c3, col_values=(('external_ids', {'iface-id': '3dd72077-c3fa-46cb-a1c4-94d45363d166', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:1e:ef', 'vm-uuid': 'ca881c57-12a8-4cb9-9d07-6f839b158dc6'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:03 user nova-compute[73029]: INFO os_vif [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3dd72077-c3fa-46cb-a1c4-94d45363d166,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd72077-c3')
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:22:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No VIF found with MAC fa:16:3e:01:1e:ef, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:22:04 user nova-compute[73029]: DEBUG nova.network.neutron [req-0288194b-729f-48f5-ba57-43eb4ea235af req-3fbcb81f-e190-4f1e-a02c-68f83b5483eb service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updated VIF entry in instance network info cache for port 3dd72077-c3fa-46cb-a1c4-94d45363d166. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:22:04 user nova-compute[73029]: DEBUG nova.network.neutron [req-0288194b-729f-48f5-ba57-43eb4ea235af req-3fbcb81f-e190-4f1e-a02c-68f83b5483eb service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updating instance_info_cache with network_info: [{"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:22:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0288194b-729f-48f5-ba57-43eb4ea235af req-3fbcb81f-e190-4f1e-a02c-68f83b5483eb service nova] Releasing lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-da73309e-ccd6-498b-94a4-37d49e9082d0 req-8a2c4d75-ca93-4dde-8d5d-3b179e3eead6 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received event network-vif-plugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-da73309e-ccd6-498b-94a4-37d49e9082d0 req-8a2c4d75-ca93-4dde-8d5d-3b179e3eead6 service nova] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-da73309e-ccd6-498b-94a4-37d49e9082d0 req-8a2c4d75-ca93-4dde-8d5d-3b179e3eead6 service nova] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-da73309e-ccd6-498b-94a4-37d49e9082d0 req-8a2c4d75-ca93-4dde-8d5d-3b179e3eead6 service nova] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-da73309e-ccd6-498b-94a4-37d49e9082d0 req-8a2c4d75-ca93-4dde-8d5d-3b179e3eead6 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] No waiting events found dispatching network-vif-plugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:22:05 user nova-compute[73029]: WARNING nova.compute.manager [req-da73309e-ccd6-498b-94a4-37d49e9082d0 req-8a2c4d75-ca93-4dde-8d5d-3b179e3eead6 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received unexpected event network-vif-plugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 for instance with vm_state building and task_state spawning.
Aug 10 01:22:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630527.3249438, ca881c57-12a8-4cb9-9d07-6f839b158dc6 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:22:07 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] VM Resumed (Lifecycle Event)
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:22:07 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Instance spawned successfully.
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:22:07 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630527.3263617, ca881c57-12a8-4cb9-9d07-6f839b158dc6 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:22:07 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] VM Started (Lifecycle Event)
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:22:07 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:22:07 user nova-compute[73029]: INFO nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.compute.manager [req-56201203-dbbc-4bb0-b5b8-e205dad223f1 req-b89cc4ac-b6ef-46a9-a4d5-feb3aa524109 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received event network-vif-plugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-56201203-dbbc-4bb0-b5b8-e205dad223f1 req-b89cc4ac-b6ef-46a9-a4d5-feb3aa524109 service nova] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-56201203-dbbc-4bb0-b5b8-e205dad223f1 req-b89cc4ac-b6ef-46a9-a4d5-feb3aa524109 service nova] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-56201203-dbbc-4bb0-b5b8-e205dad223f1 req-b89cc4ac-b6ef-46a9-a4d5-feb3aa524109 service nova] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:22:07 user nova-compute[73029]: DEBUG nova.compute.manager [req-56201203-dbbc-4bb0-b5b8-e205dad223f1 req-b89cc4ac-b6ef-46a9-a4d5-feb3aa524109 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] No waiting events found dispatching network-vif-plugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:22:07 user nova-compute[73029]: WARNING nova.compute.manager [req-56201203-dbbc-4bb0-b5b8-e205dad223f1 req-b89cc4ac-b6ef-46a9-a4d5-feb3aa524109 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received unexpected event network-vif-plugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 for instance with vm_state building and task_state spawning.
Aug 10 01:22:07 user nova-compute[73029]: INFO nova.compute.manager [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Took 6.36 seconds to build instance.
Aug 10 01:22:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b77405e-e9a8-45d1-bddd-8f3b2bcc0225 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.455s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:22:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:22:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:22:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:22:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:22:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:22:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:22:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:22:52 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:22:55 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updating instance_info_cache with network_info: [{"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:22:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:01 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:23:01 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:23:01 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=25.05236053466797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 64703aae-93b4-4173-80c8-7e39ab9cd667 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:23:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:23:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:23:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:23:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:23:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:23:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:23:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:23:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:23:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:23:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:23:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:23:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:23:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:23:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:23:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:23:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:23:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:23:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:23:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-8ee927a3-a641-40f6-8594-0aacc6cc741f req-429893b8-0ff7-43ab-8fbf-edc71b03bf16 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received event network-changed-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:23:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-8ee927a3-a641-40f6-8594-0aacc6cc741f req-429893b8-0ff7-43ab-8fbf-edc71b03bf16 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Refreshing instance network info cache due to event network-changed-1beccb06-baa7-4cd5-aaa9-dbed80459ef5. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:23:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8ee927a3-a641-40f6-8594-0aacc6cc741f req-429893b8-0ff7-43ab-8fbf-edc71b03bf16 service nova] Acquiring lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:23:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8ee927a3-a641-40f6-8594-0aacc6cc741f req-429893b8-0ff7-43ab-8fbf-edc71b03bf16 service nova] Acquired lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:23:31 user nova-compute[73029]: DEBUG nova.network.neutron [req-8ee927a3-a641-40f6-8594-0aacc6cc741f req-429893b8-0ff7-43ab-8fbf-edc71b03bf16 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Refreshing network info cache for port 1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:23:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:23:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:23:31 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'flavor' on Instance uuid 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:23:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Ignoring supplied device name: /dev/vdb
Aug 10 01:23:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:23:32 user nova-compute[73029]: INFO nova.compute.manager [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Attaching volume 123d8b5b-be26-4031-99ac-1b99f93a09a9 to /dev/vdb
Aug 10 01:23:32 user nova-compute[73029]: DEBUG nova.network.neutron [req-8ee927a3-a641-40f6-8594-0aacc6cc741f req-429893b8-0ff7-43ab-8fbf-edc71b03bf16 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updated VIF entry in instance network info cache for port 1beccb06-baa7-4cd5-aaa9-dbed80459ef5. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG nova.network.neutron [req-8ee927a3-a641-40f6-8594-0aacc6cc741f req-429893b8-0ff7-43ab-8fbf-edc71b03bf16 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updating instance_info_cache with network_info: [{"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG os_brick.utils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8ee927a3-a641-40f6-8594-0aacc6cc741f req-429893b8-0ff7-43ab-8fbf-edc71b03bf16 service nova] Releasing lock "refresh_cache-64703aae-93b4-4173-80c8-7e39ab9cd667" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[093ee77d-7e0e-40f5-b725-71f210572567]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346827b-13d2-4809-a21e-14b392b2005d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[979e5aae-e36b-4ce9-98f4-a74643ca0b86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd15f17-d758-443c-afdf-cc9e617e3ef8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:23:32 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:23:32 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f972f1-ace4-467d-9fbd-7138453930aa]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG os_brick.utils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:23:32 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updating existing volume attachment record: e41a5a32-7fcc-491a-863c-58a76b790785 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:23:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:23:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:23:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:23:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:23:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaKuRQyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:23:45 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:23:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:23:45 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:23:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:23:45 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:23:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[490277e8-c80a-4a16-8e9c-55be7b97d301]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:23:45 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e2b879-a393-4520-8418-fde943f756c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9] added
Aug 10 01:23:45 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:23:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7406f1f-a47f-4c48-ba0b-095a614b4544]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae9553-3697-4937-829b-077c087f22da]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaKuRQyw {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaKuRQyw" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[10acf614-4edf-42f2-8054-d64220d68f3c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xaKuRQyw'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b755a77-c4b9-4641-9ee1-bc41b729b4fb]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[82120050-bc7f-43b3-a8b5-92d851e207e6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:23:46 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:23:46 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:23:46 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:23:46 user nova-compute[73029]: 
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac1371-1466-4c93-b85d-6699500e1bea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9, portal: 172.16.0.220,3260]
Aug 10 01:23:46 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9, portal: 172.16.0.220,3260] successful.
Aug 10 01:23:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82c2650-f5cc-4b7b-9740-0c15f074809e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[beefe390-4065-4982-959e-ad67aa90201f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)
Aug 10 01:23:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)
Aug 10 01:23:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dde7182-5e13-4512-9cfe-3bb23de155aa]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:23:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaKuRQyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:23:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:23:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23530643161363134', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:23:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530643161363134', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:23:47 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'flavor' on Instance uuid 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:23:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:23:47 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:23:47 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:23:47 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:23:47 user nova-compute[73029]:   <serial>123d8b5b-be26-4031-99ac-1b99f93a09a9</serial>
Aug 10 01:23:47 user nova-compute[73029]: </disk>
Aug 10 01:23:47 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:23:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:23:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:23:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] No VIF found with MAC fa:16:3e:73:f5:8c, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:23:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b7e23e14-c406-4947-87dd-654f94089c7f tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.685s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:23:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-cd9da195-04a3-4982-8c43-0957e8b33bd8 req-6aee12f6-93d7-4df1-b0f9-628297a811f3 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received event network-changed-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:23:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-cd9da195-04a3-4982-8c43-0957e8b33bd8 req-6aee12f6-93d7-4df1-b0f9-628297a811f3 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Refreshing instance network info cache due to event network-changed-3dd72077-c3fa-46cb-a1c4-94d45363d166. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:23:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cd9da195-04a3-4982-8c43-0957e8b33bd8 req-6aee12f6-93d7-4df1-b0f9-628297a811f3 service nova] Acquiring lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:23:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cd9da195-04a3-4982-8c43-0957e8b33bd8 req-6aee12f6-93d7-4df1-b0f9-628297a811f3 service nova] Acquired lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:23:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-cd9da195-04a3-4982-8c43-0957e8b33bd8 req-6aee12f6-93d7-4df1-b0f9-628297a811f3 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Refreshing network info cache for port 3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:23:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-cd9da195-04a3-4982-8c43-0957e8b33bd8 req-6aee12f6-93d7-4df1-b0f9-628297a811f3 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updated VIF entry in instance network info cache for port 3dd72077-c3fa-46cb-a1c4-94d45363d166. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:23:52 user nova-compute[73029]: DEBUG nova.network.neutron [req-cd9da195-04a3-4982-8c43-0957e8b33bd8 req-6aee12f6-93d7-4df1-b0f9-628297a811f3 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updating instance_info_cache with network_info: [{"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:23:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cd9da195-04a3-4982-8c43-0957e8b33bd8 req-6aee12f6-93d7-4df1-b0f9-628297a811f3 service nova] Releasing lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:23:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:23:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:23:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:23:55 user nova-compute[73029]: DEBUG nova.objects.instance [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:23:56 user nova-compute[73029]: INFO nova.compute.manager [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Attaching volume 55a4ebc2-0e42-457a-b653-25cef2454564 to /dev/vdb
Aug 10 01:23:56 user nova-compute[73029]: DEBUG os_brick.utils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f2044e-8935-4292-a632-c6650bcc08d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1288ec0-b5dd-4343-8547-9c3057c990d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a14fa63-2586-49ee-8ee8-8d28d5422303]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf73ac-b8f9-46fb-9cb2-66600987b4ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:23:56 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:23:56 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6be2943-3cc8-4cd6-b716-6dc5f355c6ac]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG os_brick.utils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:23:56 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updating existing volume attachment record: 03c0baab-6db4-4507-8feb-c4e20b8d18c8 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:23:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:23:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:00 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:24:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:24:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:24:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:24:00 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:24:00 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updating instance_info_cache with network_info: [{"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:24:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-ca881c57-12a8-4cb9-9d07-6f839b158dc6" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:24:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:24:01 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:24:01 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:24:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:24:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8655MB free_disk=25.051025390625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 64703aae-93b4-4173-80c8-7e39ab9cd667 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdXzbhuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:24:04 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:24:04 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:24:04 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df63b3d-bee8-45b5-8967-1ffe626a5b7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:24:04 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2018ef2a-ee66-4d1c-884c-c6b97ec9c5b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564] added
Aug 10 01:24:04 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9651d649-a094-48e5-a192-049c75444a9c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f2aca-6598-4fd7-bf4a-1f58d7d109b9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdXzbhuO {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdXzbhuO" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcee9fd5-45ab-4c2f-9253-76338b64bbb3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HdXzbhuO'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c282a1-e474-4940-a028-0f717e5b8b0d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa52b00-b667-4581-a14c-f311e43dced2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)
Aug 10 01:24:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)
Aug 10 01:24:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fde856b-f648-40bc-81d1-5ee3d3e15242]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564, portal: 172.16.0.220,3260]
Aug 10 01:24:05 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564, portal: 172.16.0.220,3260] successful.
Aug 10 01:24:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f49fa8b-a86b-47dd-bb25-d71114debdec]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1fa092-db32-41d2-bc7e-f57852972cb7]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)
Aug 10 01:24:05 user nova-compute[73029]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)
Aug 10 01:24:05 user nova-compute[73029]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:05 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd20533-0c30-4bdd-83ac-413fda8f1f06]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:05 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdXzbhuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26632313266376136', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632313266376136', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG nova.objects.instance [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:24:06 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:24:06 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 01:24:06 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:24:06 user nova-compute[73029]:   <serial>55a4ebc2-0e42-457a-b653-25cef2454564</serial>
Aug 10 01:24:06 user nova-compute[73029]: </disk>
Aug 10 01:24:06 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No VIF found with MAC fa:16:3e:01:1e:ef, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:24:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6c6b58c4-3908-40d6-ae8f-5e1cb6df5d81 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.595s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:24:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:24:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:24:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:10 user nova-compute[73029]: INFO nova.compute.manager [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Attaching volume 625f0563-c2a9-457d-a47f-17d68768c073 to /dev/vdc
Aug 10 01:24:10 user nova-compute[73029]: DEBUG os_brick.utils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c77a62-1d5f-40cb-bd3f-0604d140ebe2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c404f6d1-66e4-460e-9ce9-ec7570cfd77f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba2ac95-7bca-4be3-be5a-a71a5ef4bed5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6221c817-ab8e-4d12-9410-1ea4262f6acd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:24:10 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:24:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c62f54e-ae2f-41b8-a15e-baa75229010b]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG os_brick.utils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:24:10 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updating existing volume attachment record: 4ff1cda6-1fb3-4007-893d-f3f21bf57bef {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:24:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:24:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:24:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:24:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:24:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:24:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:18 user nova-compute[73029]: INFO nova.compute.manager [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Detaching volume 123d8b5b-be26-4031-99ac-1b99f93a09a9
Aug 10 01:24:18 user nova-compute[73029]: INFO nova.virt.block_device [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Attempting to driver detach volume 123d8b5b-be26-4031-99ac-1b99f93a09a9 from mountpoint /dev/vdb
Aug 10 01:24:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Attempting to detach device vdb from instance 64703aae-93b4-4173-80c8-7e39ab9cd667 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:24:18 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:24:18 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:24:18 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:24:18 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:24:18 user nova-compute[73029]:   <serial>123d8b5b-be26-4031-99ac-1b99f93a09a9</serial>
Aug 10 01:24:18 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:24:18 user nova-compute[73029]: </disk>
Aug 10 01:24:18 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:24:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Successfully detached device vdb from instance 64703aae-93b4-4173-80c8-7e39ab9cd667 from the persistent domain config.
Aug 10 01:24:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64703aae-93b4-4173-80c8-7e39ab9cd667 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:24:19 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:24:19 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:24:19 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:24:19 user nova-compute[73029]:   <serial>123d8b5b-be26-4031-99ac-1b99f93a09a9</serial>
Aug 10 01:24:19 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:24:19 user nova-compute[73029]: </disk>
Aug 10 01:24:19 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691630659.4399624, 64703aae-93b4-4173-80c8-7e39ab9cd667 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:24:19 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Successfully detached device vdb from instance 64703aae-93b4-4173-80c8-7e39ab9cd667 from the live domain config.
Aug 10 01:24:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaKuRQyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:24:19 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f2bcc7-4ce4-44e8-b8ef-c7891af8f96c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd0db8a-a1b4-420b-b75c-53f0b85ebfc5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)
Aug 10 01:24:19 user nova-compute[73029]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:19 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 (non-flash)
Aug 10 01:24:19 user nova-compute[73029]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:19 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751c23a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eabfdf-cc07-4b2d-8a1d-ceef9a8e876e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d900d2-c8c1-4e5a-a472-bfaf90005e3c]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a801a4-6723-487f-8f59-5586f1425e47]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b75348-f72f-42fd-b7d0-f83c676539ec]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a18a3c0-5b71-4dd6-9afc-cb0070ea9ab0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d5ec15-e51a-4604-a334-823dfe4bbc17]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9, portal: 172.16.0.220,3260]
Aug 10 01:24:19 user nova-compute[73029]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9, portal: 172.16.0.220,3260] successful.
Aug 10 01:24:19 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[215ee6b4-c850-42e0-8ce4-3ab5d439b05c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] <== disconnect_volume: return (256ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:24:19 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG nova.objects.instance [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'flavor' on Instance uuid 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-14f83f88-e56e-4b80-a8af-ab8a9b3019b8 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.476s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:20 user nova-compute[73029]: INFO nova.compute.manager [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Terminating instance
Aug 10 01:24:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-1db9b612-085f-4ae1-ae2f-f738fe12464f req-1b9ee36a-6115-48e7-adb1-e13f798ede2e service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received event network-vif-unplugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1db9b612-085f-4ae1-ae2f-f738fe12464f req-1b9ee36a-6115-48e7-adb1-e13f798ede2e service nova] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1db9b612-085f-4ae1-ae2f-f738fe12464f req-1b9ee36a-6115-48e7-adb1-e13f798ede2e service nova] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1db9b612-085f-4ae1-ae2f-f738fe12464f req-1b9ee36a-6115-48e7-adb1-e13f798ede2e service nova] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-1db9b612-085f-4ae1-ae2f-f738fe12464f req-1b9ee36a-6115-48e7-adb1-e13f798ede2e service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] No waiting events found dispatching network-vif-unplugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:24:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-1db9b612-085f-4ae1-ae2f-f738fe12464f req-1b9ee36a-6115-48e7-adb1-e13f798ede2e service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received event network-vif-unplugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Instance destroyed successfully.
Aug 10 01:24:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lazy-loading 'resources' on Instance uuid 64703aae-93b4-4173-80c8-7e39ab9cd667 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-494535847',display_name='tempest-VolumesSnapshotTestJSON-instance-494535847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-494535847',id=41,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg8i0GP/q5nhDrt5herh/aaJeezQLWFVlQ9ZtZMV31NFWlCUkj2yu1xLlArSXZyaJ4kfaoWkHF4Ygf3GK6kBRl1Z7mDs22n46FK58WGQV4wh3Wwi+RT+6Bvfbe1IUUWTg==',key_name='tempest-keypair-685177842',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:21:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7bda2c5abe742c6af24393e22e87321',ramdisk_id='',reservation_id='r-snkpl0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1971863414',owner_user_name='tempest-VolumesSnapshotTestJSON-1971863414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:21:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2bf5ce780542cca24b37e3f929dc32',uuid=64703aae-93b4-4173-80c8-7e39ab9cd667,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converting VIF {"id": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "address": "fa:16:3e:73:f5:8c", "network": {"id": "cab137e6-1e2d-46df-892c-1cd2f5d71e21", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-515550564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bda2c5abe742c6af24393e22e87321", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beccb06-ba", "ovs_interfaceid": "1beccb06-baa7-4cd5-aaa9-dbed80459ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:8c,bridge_name='br-int',has_traffic_filtering=True,id=1beccb06-baa7-4cd5-aaa9-dbed80459ef5,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beccb06-ba') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_vif [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:8c,bridge_name='br-int',has_traffic_filtering=True,id=1beccb06-baa7-4cd5-aaa9-dbed80459ef5,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beccb06-ba') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1beccb06-ba, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:24:21 user nova-compute[73029]: INFO os_vif [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:8c,bridge_name='br-int',has_traffic_filtering=True,id=1beccb06-baa7-4cd5-aaa9-dbed80459ef5,network=Network(cab137e6-1e2d-46df-892c-1cd2f5d71e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beccb06-ba')
Aug 10 01:24:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaKuRQyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:24:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:123d8b5b-be26-4031-99ac-1b99f93a09a9', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[38369b34-b636-46d9-8b1b-dabdd7c05457]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bb1c5c-1ea6-420d-8462-65dd4a3edcd4]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751411b370>, {}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Disconnecting from: [] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] <== disconnect_volume: return (50ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:24:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Deleting instance files /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667_del
Aug 10 01:24:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Deletion of /opt/stack/data/nova/instances/64703aae-93b4-4173-80c8-7e39ab9cd667_del complete
Aug 10 01:24:21 user nova-compute[73029]: INFO nova.compute.manager [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 10 01:24:21 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:24:21 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:24:22 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Took 1.19 seconds to deallocate network for instance.
Aug 10 01:24:22 user nova-compute[73029]: WARNING nova.volume.cinder [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Attachment e41a5a32-7fcc-491a-863c-58a76b790785 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e41a5a32-7fcc-491a-863c-58a76b790785. (HTTP 404) (Request-ID: req-89aa7c8e-86ea-4ad2-b86e-b0de70fe8b91)
Aug 10 01:24:22 user nova-compute[73029]: INFO nova.compute.manager [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Took 0.02 seconds to detach 1 volumes for instance.
Aug 10 01:24:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-a4553f6d-3a6b-4f6d-8e5c-60262a986a7f req-e8f9d274-6144-47ca-baea-78099cdf2ed0 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received event network-vif-plugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a4553f6d-3a6b-4f6d-8e5c-60262a986a7f req-e8f9d274-6144-47ca-baea-78099cdf2ed0 service nova] Acquiring lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a4553f6d-3a6b-4f6d-8e5c-60262a986a7f req-e8f9d274-6144-47ca-baea-78099cdf2ed0 service nova] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-a4553f6d-3a6b-4f6d-8e5c-60262a986a7f req-e8f9d274-6144-47ca-baea-78099cdf2ed0 service nova] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-a4553f6d-3a6b-4f6d-8e5c-60262a986a7f req-e8f9d274-6144-47ca-baea-78099cdf2ed0 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] No waiting events found dispatching network-vif-plugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:24:22 user nova-compute[73029]: WARNING nova.compute.manager [req-a4553f6d-3a6b-4f6d-8e5c-60262a986a7f req-e8f9d274-6144-47ca-baea-78099cdf2ed0 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received unexpected event network-vif-plugged-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 for instance with vm_state deleted and task_state None.
Aug 10 01:24:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-a4553f6d-3a6b-4f6d-8e5c-60262a986a7f req-e8f9d274-6144-47ca-baea-78099cdf2ed0 service nova] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Received event network-vif-deleted-1beccb06-baa7-4cd5-aaa9-dbed80459ef5 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:24:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:22 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Deleted allocations for instance 64703aae-93b4-4173-80c8-7e39ab9cd667
Aug 10 01:24:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c736c2a2-60b9-4695-8301-a76af9c40648 tempest-VolumesSnapshotTestJSON-1971863414 tempest-VolumesSnapshotTestJSON-1971863414-project-member] Lock "64703aae-93b4-4173-80c8-7e39ab9cd667" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.469s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTJnYdCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:24:23 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:24:23 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:24:23 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8badf5a-9382-4fa4-88c3-1d9c422a1d9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:24:23 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71e6e96-ed7d-4174-8934-c5df995dd7b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073] added
Aug 10 01:24:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa66c87b-89d9-42e4-a944-9f940195cf08]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d1877b-3a81-4828-aba7-f0beb1acc930]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTJnYdCZ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTJnYdCZ" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1348b701-4920-4cac-9e13-631683614390]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fTJnYdCZ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90231b7-e792-421f-91b8-0fe9fc89a5eb]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577f86a-463e-4433-9bcd-cd129e6a1c08]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a80902-3ba5-4c34-84a0-68e36766b70a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073, portal: 172.16.0.220,3260]
Aug 10 01:24:23 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073, portal: 172.16.0.220,3260] successful.
Aug 10 01:24:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6fd8a5-84bf-4986-bd3b-2eac6f496ece]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef94346-f4d1-4bba-a17e-c36ba1516c62]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:23 user nova-compute[73029]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 (non-flash)
Aug 10 01:24:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:23 user nova-compute[73029]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 (non-flash)
Aug 10 01:24:23 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ae8aa8-3951-43c0-8722-bb79fb5d91e2]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:23 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:24:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:24:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTJnYdCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:24:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:24:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23365333135306464', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:24:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365333135306464', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:24:24 user nova-compute[73029]: DEBUG nova.objects.instance [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:24:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:24:24 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:24:24 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:24:24 user nova-compute[73029]:   <target dev="vdc" bus="virtio"/>
Aug 10 01:24:24 user nova-compute[73029]:   <serial>625f0563-c2a9-457d-a47f-17d68768c073</serial>
Aug 10 01:24:24 user nova-compute[73029]: </disk>
Aug 10 01:24:24 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:24:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:24:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:24:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:24:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] No VIF found with MAC fa:16:3e:01:1e:ef, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:24:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-869fac3e-d167-4281-81a6-dd9fafaf09b2 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.558s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:26 user nova-compute[73029]: INFO nova.compute.manager [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Detaching volume 55a4ebc2-0e42-457a-b653-25cef2454564
Aug 10 01:24:26 user nova-compute[73029]: INFO nova.virt.block_device [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Attempting to driver detach volume 55a4ebc2-0e42-457a-b653-25cef2454564 from mountpoint /dev/vdb
Aug 10 01:24:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Attempting to detach device vdb from instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:24:26 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:24:26 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 01:24:26 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:24:26 user nova-compute[73029]:   <serial>55a4ebc2-0e42-457a-b653-25cef2454564</serial>
Aug 10 01:24:26 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:24:26 user nova-compute[73029]: </disk>
Aug 10 01:24:26 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully detached device vdb from instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 from the persistent domain config.
Aug 10 01:24:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:24:26 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:24:26 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 01:24:26 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:24:26 user nova-compute[73029]:   <serial>55a4ebc2-0e42-457a-b653-25cef2454564</serial>
Aug 10 01:24:26 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:24:26 user nova-compute[73029]: </disk>
Aug 10 01:24:26 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691630666.7312825, ca881c57-12a8-4cb9-9d07-6f839b158dc6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:24:26 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully detached device vdb from instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 from the live domain config.
Aug 10 01:24:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdXzbhuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:24:26 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[908abfca-564b-4924-9027-41bd677e1b21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[62073e0d-2e2c-4fce-89ff-e726fd369fce]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:26 user nova-compute[73029]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 (non-flash)
Aug 10 01:24:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 (non-flash)
Aug 10 01:24:26 user nova-compute[73029]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 (non-flash)
Aug 10 01:24:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f07409d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[63489d92-055f-493b-bbfa-687075625b2b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba0858b-cab7-489b-9acc-ee82d93a153c]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d626c21-d8e5-4d02-873d-1d4b6b4bcd0e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0dcac1-84ab-489b-931a-e00d185859a7]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e953730b-daa2-4412-aa93-4cc0315b887e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5c4935-d54e-43f9-be07-2696701a13ea]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564, portal: 172.16.0.220,3260]
Aug 10 01:24:26 user nova-compute[73029]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564, portal: 172.16.0.220,3260] successful.
Aug 10 01:24:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a4ebc2-0e42-457a-b653-25cef2454564 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d631d95-6019-40b0-9323-60d4bf192b09]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== disconnect_volume: return (248ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:24:26 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:24:27 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:24:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5e5e3cfb-397f-4732-9a0e-d67dfd8eb03b tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:28 user nova-compute[73029]: INFO nova.compute.manager [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Detaching volume 625f0563-c2a9-457d-a47f-17d68768c073
Aug 10 01:24:28 user nova-compute[73029]: INFO nova.virt.block_device [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Attempting to driver detach volume 625f0563-c2a9-457d-a47f-17d68768c073 from mountpoint /dev/vdc
Aug 10 01:24:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Attempting to detach device vdc from instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:24:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:24:28 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:24:28 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:24:28 user nova-compute[73029]:   <target dev="vdc" bus="virtio"/>
Aug 10 01:24:28 user nova-compute[73029]:   <serial>625f0563-c2a9-457d-a47f-17d68768c073</serial>
Aug 10 01:24:28 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 10 01:24:28 user nova-compute[73029]: </disk>
Aug 10 01:24:28 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:24:28 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully detached device vdc from instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 from the persistent domain config.
Aug 10 01:24:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:24:28 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:24:28 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:24:28 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:24:28 user nova-compute[73029]:   <target dev="vdc" bus="virtio"/>
Aug 10 01:24:28 user nova-compute[73029]:   <serial>625f0563-c2a9-457d-a47f-17d68768c073</serial>
Aug 10 01:24:28 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 10 01:24:28 user nova-compute[73029]: </disk>
Aug 10 01:24:28 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691630669.0556865, ca881c57-12a8-4cb9-9d07-6f839b158dc6 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:24:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully detached device vdc from instance ca881c57-12a8-4cb9-9d07-6f839b158dc6 from the live domain config.
Aug 10 01:24:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTJnYdCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:24:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e32955f-475b-4349-8d12-7a81e8f46db5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[624b2539-9e89-401b-a8af-bddd77e1f78c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 (non-flash)
Aug 10 01:24:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 (non-flash)
Aug 10 01:24:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141a6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f094cb4-7209-47e8-8684-cad544133a20]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[224dbd42-82ac-4ef2-823c-e314c6e7df8b]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21cf3b8-1da4-4a01-8af0-d7fee0d63659]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db6724-399d-4874-a621-752c8992e065]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ead814-91fd-487a-9875-f2582efe655d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[80765ad1-7baa-41ce-b6b5-98306587160d]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073, portal: 172.16.0.220,3260]
Aug 10 01:24:29 user nova-compute[73029]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073, portal: 172.16.0.220,3260] successful.
Aug 10 01:24:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f0563-c2a9-457d-a47f-17d68768c073 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0341e665-8235-493d-9d0d-555014171b5a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] <== disconnect_volume: return (283ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:24:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:24:30 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'flavor' on Instance uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:24:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4ce8bc50-a2da-4426-ba68-25e00afb0419 tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:31 user nova-compute[73029]: INFO nova.compute.manager [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Terminating instance
Aug 10 01:24:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-610b7ce4-d567-4a77-90b9-9fe0a4f3a415 req-e8767a3c-7378-405e-a15f-d3cef9cbdb39 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received event network-vif-unplugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-610b7ce4-d567-4a77-90b9-9fe0a4f3a415 req-e8767a3c-7378-405e-a15f-d3cef9cbdb39 service nova] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-610b7ce4-d567-4a77-90b9-9fe0a4f3a415 req-e8767a3c-7378-405e-a15f-d3cef9cbdb39 service nova] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-610b7ce4-d567-4a77-90b9-9fe0a4f3a415 req-e8767a3c-7378-405e-a15f-d3cef9cbdb39 service nova] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-610b7ce4-d567-4a77-90b9-9fe0a4f3a415 req-e8767a3c-7378-405e-a15f-d3cef9cbdb39 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] No waiting events found dispatching network-vif-unplugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG nova.compute.manager [req-610b7ce4-d567-4a77-90b9-9fe0a4f3a415 req-e8767a3c-7378-405e-a15f-d3cef9cbdb39 service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received event network-vif-unplugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:32 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Instance destroyed successfully.
Aug 10 01:24:32 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lazy-loading 'resources' on Instance uuid ca881c57-12a8-4cb9-9d07-6f839b158dc6 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-242367032',display_name='tempest-AttachVolumeTestJSON-server-242367032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-242367032',id=42,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOkH3PyxgZvqzTv+KK41sPKbENghQWaDkZCtbfY1hSQ8HH7kULjcu5T7lj1mIkvIA7ubp+i2LdLq5syIwoUJmmHuebOt8xizx+g/o6k8kInov7X7cjmfv7Kn+Zd/hC6CA==',key_name='tempest-keypair-273713983',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27575d6efb9a45b2b9b38f2bbed286ec',ramdisk_id='',reservation_id='r-cd3dh0e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1442739203',owner_user_name='tempest-AttachVolumeTestJSON-1442739203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8ab867cd18c4fbfb8c38f2d4666be8e',uuid=ca881c57-12a8-4cb9-9d07-6f839b158dc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converting VIF {"id": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "address": "fa:16:3e:01:1e:ef", "network": {"id": "aaa4d1ed-b314-4a25-ba67-f58dd86c1c48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-774671961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27575d6efb9a45b2b9b38f2bbed286ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd72077-c3", "ovs_interfaceid": "3dd72077-c3fa-46cb-a1c4-94d45363d166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3dd72077-c3fa-46cb-a1c4-94d45363d166,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd72077-c3') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG os_vif [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3dd72077-c3fa-46cb-a1c4-94d45363d166,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd72077-c3') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dd72077-c3, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:24:32 user nova-compute[73029]: INFO os_vif [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3dd72077-c3fa-46cb-a1c4-94d45363d166,network=Network(aaa4d1ed-b314-4a25-ba67-f58dd86c1c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd72077-c3')
Aug 10 01:24:32 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Deleting instance files /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6_del
Aug 10 01:24:32 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Deletion of /opt/stack/data/nova/instances/ca881c57-12a8-4cb9-9d07-6f839b158dc6_del complete
Aug 10 01:24:32 user nova-compute[73029]: INFO nova.compute.manager [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 10 01:24:32 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:24:32 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Took 0.78 seconds to deallocate network for instance.
Aug 10 01:24:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:33 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:24:33 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:24:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:33 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Deleted allocations for instance ca881c57-12a8-4cb9-9d07-6f839b158dc6
Aug 10 01:24:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4bb01654-3a94-4d85-b4e2-491306e3c0ab tempest-AttachVolumeTestJSON-1442739203 tempest-AttachVolumeTestJSON-1442739203-project-member] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.880s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-55a13f3e-7c75-4025-b0dd-b23a7472eb09 req-8e949ab2-5cc1-4a64-b9c1-e41826052a6c service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received event network-vif-plugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:24:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-55a13f3e-7c75-4025-b0dd-b23a7472eb09 req-8e949ab2-5cc1-4a64-b9c1-e41826052a6c service nova] Acquiring lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:24:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-55a13f3e-7c75-4025-b0dd-b23a7472eb09 req-8e949ab2-5cc1-4a64-b9c1-e41826052a6c service nova] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:24:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-55a13f3e-7c75-4025-b0dd-b23a7472eb09 req-8e949ab2-5cc1-4a64-b9c1-e41826052a6c service nova] Lock "ca881c57-12a8-4cb9-9d07-6f839b158dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:24:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-55a13f3e-7c75-4025-b0dd-b23a7472eb09 req-8e949ab2-5cc1-4a64-b9c1-e41826052a6c service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] No waiting events found dispatching network-vif-plugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:24:33 user nova-compute[73029]: WARNING nova.compute.manager [req-55a13f3e-7c75-4025-b0dd-b23a7472eb09 req-8e949ab2-5cc1-4a64-b9c1-e41826052a6c service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received unexpected event network-vif-plugged-3dd72077-c3fa-46cb-a1c4-94d45363d166 for instance with vm_state deleted and task_state None.
Aug 10 01:24:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-55a13f3e-7c75-4025-b0dd-b23a7472eb09 req-8e949ab2-5cc1-4a64-b9c1-e41826052a6c service nova] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Received event network-vif-deleted-3dd72077-c3fa-46cb-a1c4-94d45363d166 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:24:36 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691630661.2352128, 64703aae-93b4-4173-80c8-7e39ab9cd667 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:24:36 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] VM Stopped (Lifecycle Event)
Aug 10 01:24:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-045a4886-be7f-4911-a045-b7edca6f9aba None None] [instance: 64703aae-93b4-4173-80c8-7e39ab9cd667] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:24:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:24:47 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691630672.024107, ca881c57-12a8-4cb9-9d07-6f839b158dc6 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:24:47 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] VM Stopped (Lifecycle Event)
Aug 10 01:24:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-08966446-a5d6-4313-947c-41f49a42b7e9 None None] [instance: ca881c57-12a8-4cb9-9d07-6f839b158dc6] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:24:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:24:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:24:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:24:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:24:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:24:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:24:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:24:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:24:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:24:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:24:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:24:58 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:25:01 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:25:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:25:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:25:01 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:25:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:25:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:25:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:25:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:25:03 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:25:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.105152130126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:25:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:25:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:25:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:25:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:25:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:25:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:25:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:25:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:25:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:25:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:25:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:25:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:25:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:25:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:26:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:26:02 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:26:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:26:05 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:26:05 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:26:05 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.094318389892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:26:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:26:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "446dc134-cae8-46b1-81db-da81488d6b56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:26:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "446dc134-cae8-46b1-81db-da81488d6b56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:26:32 user nova-compute[73029]: DEBUG nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:26:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:26:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:26:32 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:26:32 user nova-compute[73029]: INFO nova.compute.claims [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Claim successful on node user
Aug 10 01:26:32 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:26:32 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:26:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:26:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:26:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:26:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:26:33 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:26:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:26:33 user nova-compute[73029]: INFO nova.virt.block_device [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Booting with volume snapshot 15f55c7c-bf69-497c-bc03-2571c14f6c8b at /dev/vda
Aug 10 01:26:33 user nova-compute[73029]: DEBUG nova.policy [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44698a7ae911479eb2d5d8a8103ac5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b217381b301d4650bc046a0031d044a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:26:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Successfully created port: 92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:26:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Successfully updated port: 92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:26:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:26:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquired lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:26:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:26:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-778f1b28-23e5-4df2-b075-97bb676fd860 req-59c26158-289a-4bd2-90f9-092af0374d71 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received event network-changed-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG nova.compute.manager [req-778f1b28-23e5-4df2-b075-97bb676fd860 req-59c26158-289a-4bd2-90f9-092af0374d71 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Refreshing instance network info cache due to event network-changed-92959eff-af4b-43a8-88ae-36b2dfe98cc2. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-778f1b28-23e5-4df2-b075-97bb676fd860 req-59c26158-289a-4bd2-90f9-092af0374d71 service nova] Acquiring lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG nova.network.neutron [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updating instance_info_cache with network_info: [{"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Releasing lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Instance network_info: |[{"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-778f1b28-23e5-4df2-b075-97bb676fd860 req-59c26158-289a-4bd2-90f9-092af0374d71 service nova] Acquired lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG nova.network.neutron [req-778f1b28-23e5-4df2-b075-97bb676fd860 req-59c26158-289a-4bd2-90f9-092af0374d71 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Refreshing network info cache for port 92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG nova.network.neutron [req-778f1b28-23e5-4df2-b075-97bb676fd860 req-59c26158-289a-4bd2-90f9-092af0374d71 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updated VIF entry in instance network info cache for port 92959eff-af4b-43a8-88ae-36b2dfe98cc2. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG nova.network.neutron [req-778f1b28-23e5-4df2-b075-97bb676fd860 req-59c26158-289a-4bd2-90f9-092af0374d71 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updating instance_info_cache with network_info: [{"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:26:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-778f1b28-23e5-4df2-b075-97bb676fd860 req-59c26158-289a-4bd2-90f9-092af0374d71 service nova] Releasing lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:26:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG os_brick.utils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10fcdb3-b60e-419f-8062-3f0dd5e1617e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a161b0-1cc8-41d3-9eaf-1fd612aa9e90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3e5c52-f2e9-4c66-9498-2fec51e9984f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ff493-9d82-418d-9e9c-d4b6faeaad81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:26:38 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:26:38 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6ad05f-cd49-4394-b997-4443c3de4017]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG os_brick.utils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:26:38 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updating existing volume attachment record: c87f86d6-2f4f-404d-8d9f-139c765c69cc {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:26:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:26:47 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Creating image(s)
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Ensure instance console log exists: /opt/stack/data/nova/instances/446dc134-cae8-46b1-81db-da81488d6b56/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Start _get_guest_xml network_info=[{"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'c87f86d6-2f4f-404d-8d9f-139c765c69cc', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUMfckiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '446dc134-cae8-46b1-81db-da81488d6b56', 'attached_at': '', 'detached_at': '', 'volume_id': '86cb6e30-f7f6-4324-9fa6-2511bfcafbff', 'serial': '86cb6e30-f7f6-4324-9fa6-2511bfcafbff'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:26:47 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:26:47 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUMfckiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:26:47 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:26:47 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:26:47 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[750ac71e-c78c-4879-bc0e-c92885ac8aa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:26:47 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbd7067-d3ed-45ba-a46f-bec39238e961]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff] added
Aug 10 01:26:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c57b05-16c6-42ac-a35c-ea85e7aa52bc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35ee8d1-4b22-4e06-bfb0-bb9374820f0f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUMfckiR {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUMfckiR" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f8181d-f5a8-489b-8020-a555d3e62fb0]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hUMfckiR'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4ac504-cb28-4dc6-93b9-5cd6a11cb702]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9b22d8-06df-40ac-9fb9-b3d40dbde228]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:26:47 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:26:47 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:26:47 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:26:47 user nova-compute[73029]: 
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fccbd31-cf92-4a37-a0a1-b49414ca3524]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff, portal: 172.16.0.220,3260]
Aug 10 01:26:47 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff, portal: 172.16.0.220,3260] successful.
Aug 10 01:26:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b252ee-5114-4c7a-b3fd-91313971ff3b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca208922-0dbf-4d2b-956a-ab011a6052b8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)
Aug 10 01:26:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)
Aug 10 01:26:47 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a618df4-4886-459c-951c-70ca81971234]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:47 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUMfckiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26235613339653536', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235613339653536', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-653842291',display_name='tempest-TestVolumeBootPattern-server-653842291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-653842291',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-m4s8foua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:26:33Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=446dc134-cae8-46b1-81db-da81488d6b56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=92959eff-af4b-43a8-88ae-36b2dfe98cc2,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92959eff-af') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.objects.instance [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'pci_devices' on Instance uuid 446dc134-cae8-46b1-81db-da81488d6b56 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:26:48 user nova-compute[73029]:   <uuid>446dc134-cae8-46b1-81db-da81488d6b56</uuid>
Aug 10 01:26:48 user nova-compute[73029]:   <name>instance-0000002b</name>
Aug 10 01:26:48 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:26:48 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:26:48 user nova-compute[73029]:   <metadata>
Aug 10 01:26:48 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:26:48 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:26:48 user nova-compute[73029]:       <nova:name>tempest-TestVolumeBootPattern-server-653842291</nova:name>
Aug 10 01:26:48 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:26:47</nova:creationTime>
Aug 10 01:26:48 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:26:48 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:26:48 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:26:48 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:26:48 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:26:48 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:26:48 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:26:48 user nova-compute[73029]:       <nova:owner>
Aug 10 01:26:48 user nova-compute[73029]:         <nova:user uuid="44698a7ae911479eb2d5d8a8103ac5dd">tempest-TestVolumeBootPattern-1870123799-project-member</nova:user>
Aug 10 01:26:48 user nova-compute[73029]:         <nova:project uuid="b217381b301d4650bc046a0031d044a7">tempest-TestVolumeBootPattern-1870123799</nova:project>
Aug 10 01:26:48 user nova-compute[73029]:       </nova:owner>
Aug 10 01:26:48 user nova-compute[73029]:       <nova:ports>
Aug 10 01:26:48 user nova-compute[73029]:         <nova:port uuid="92959eff-af4b-43a8-88ae-36b2dfe98cc2">
Aug 10 01:26:48 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 10 01:26:48 user nova-compute[73029]:         </nova:port>
Aug 10 01:26:48 user nova-compute[73029]:       </nova:ports>
Aug 10 01:26:48 user nova-compute[73029]:     </nova:instance>
Aug 10 01:26:48 user nova-compute[73029]:   </metadata>
Aug 10 01:26:48 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:26:48 user nova-compute[73029]:     <system>
Aug 10 01:26:48 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:26:48 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:26:48 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:26:48 user nova-compute[73029]:       <entry name="serial">446dc134-cae8-46b1-81db-da81488d6b56</entry>
Aug 10 01:26:48 user nova-compute[73029]:       <entry name="uuid">446dc134-cae8-46b1-81db-da81488d6b56</entry>
Aug 10 01:26:48 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:26:48 user nova-compute[73029]:     </system>
Aug 10 01:26:48 user nova-compute[73029]:   </sysinfo>
Aug 10 01:26:48 user nova-compute[73029]:   <os>
Aug 10 01:26:48 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:26:48 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:26:48 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:26:48 user nova-compute[73029]:   </os>
Aug 10 01:26:48 user nova-compute[73029]:   <features>
Aug 10 01:26:48 user nova-compute[73029]:     <acpi/>
Aug 10 01:26:48 user nova-compute[73029]:     <apic/>
Aug 10 01:26:48 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:26:48 user nova-compute[73029]:   </features>
Aug 10 01:26:48 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:26:48 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:26:48 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:26:48 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:26:48 user nova-compute[73029]:   </clock>
Aug 10 01:26:48 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:26:48 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:26:48 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:26:48 user nova-compute[73029]:   </cpu>
Aug 10 01:26:48 user nova-compute[73029]:   <devices>
Aug 10 01:26:48 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:26:48 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:26:48 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 01:26:48 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:26:48 user nova-compute[73029]:       <serial>86cb6e30-f7f6-4324-9fa6-2511bfcafbff</serial>
Aug 10 01:26:48 user nova-compute[73029]:     </disk>
Aug 10 01:26:48 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:26:48 user nova-compute[73029]:       <mac address="fa:16:3e:7c:b8:af"/>
Aug 10 01:26:48 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:26:48 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:26:48 user nova-compute[73029]:       <target dev="tap92959eff-af"/>
Aug 10 01:26:48 user nova-compute[73029]:     </interface>
Aug 10 01:26:48 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:26:48 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/446dc134-cae8-46b1-81db-da81488d6b56/console.log" append="off"/>
Aug 10 01:26:48 user nova-compute[73029]:     </serial>
Aug 10 01:26:48 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:26:48 user nova-compute[73029]:     <video>
Aug 10 01:26:48 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:26:48 user nova-compute[73029]:     </video>
Aug 10 01:26:48 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:26:48 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:26:48 user nova-compute[73029]:     </rng>
Aug 10 01:26:48 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:26:48 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:26:48 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:26:48 user nova-compute[73029]:     </memballoon>
Aug 10 01:26:48 user nova-compute[73029]:   </devices>
Aug 10 01:26:48 user nova-compute[73029]: </domain>
Aug 10 01:26:48 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-653842291',display_name='tempest-TestVolumeBootPattern-server-653842291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-653842291',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-m4s8foua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:26:33Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=446dc134-cae8-46b1-81db-da81488d6b56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=92959eff-af4b-43a8-88ae-36b2dfe98cc2,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92959eff-af') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG os_vif [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=92959eff-af4b-43a8-88ae-36b2dfe98cc2,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92959eff-af') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92959eff-af, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92959eff-af, col_values=(('external_ids', {'iface-id': '92959eff-af4b-43a8-88ae-36b2dfe98cc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:b8:af', 'vm-uuid': '446dc134-cae8-46b1-81db-da81488d6b56'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:48 user nova-compute[73029]: INFO os_vif [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=92959eff-af4b-43a8-88ae-36b2dfe98cc2,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92959eff-af')
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:26:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No VIF found with MAC fa:16:3e:7c:b8:af, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-0bd1912a-ab86-4fa6-bcf0-9aa1c9bac700 req-0c614a88-c201-48aa-b315-583655ffa6a2 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received event network-vif-plugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0bd1912a-ab86-4fa6-bcf0-9aa1c9bac700 req-0c614a88-c201-48aa-b315-583655ffa6a2 service nova] Acquiring lock "446dc134-cae8-46b1-81db-da81488d6b56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0bd1912a-ab86-4fa6-bcf0-9aa1c9bac700 req-0c614a88-c201-48aa-b315-583655ffa6a2 service nova] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0bd1912a-ab86-4fa6-bcf0-9aa1c9bac700 req-0c614a88-c201-48aa-b315-583655ffa6a2 service nova] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-0bd1912a-ab86-4fa6-bcf0-9aa1c9bac700 req-0c614a88-c201-48aa-b315-583655ffa6a2 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] No waiting events found dispatching network-vif-plugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:26:50 user nova-compute[73029]: WARNING nova.compute.manager [req-0bd1912a-ab86-4fa6-bcf0-9aa1c9bac700 req-0c614a88-c201-48aa-b315-583655ffa6a2 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received unexpected event network-vif-plugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 for instance with vm_state building and task_state spawning.
Aug 10 01:26:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:26:51 user nova-compute[73029]: INFO nova.compute.claims [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Claim successful on node user
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:26:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:26:51 user nova-compute[73029]: INFO nova.virt.block_device [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Booting with volume 870df3e1-71ee-4d96-b3f2-b62a42a69e8a at /dev/vda
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.policy [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae1f274d3b714262bd06fde868b55aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2819848c56e4be7a3ef09731134a75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG os_brick.utils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b22348-dd7d-46df-b796-d2fe8b34c0e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dcb03f-26bc-4cda-9518-ab55eb996585]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[968ae623-698e-43d4-a82a-f80e0aa3e32f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[575d0a4d-1bc1-466f-835b-6e97306cbeac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:26:51 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:26:51 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9e336f-93cf-45fe-ad9a-93e6fee3fba3]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG os_brick.utils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:26:51 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating existing volume attachment record: 8786668d-ef62-44f2-a77f-46a1a0042bb7 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630812.2422178, 446dc134-cae8-46b1-81db-da81488d6b56 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:26:52 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] VM Resumed (Lifecycle Event)
Aug 10 01:26:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:26:52 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Instance spawned successfully.
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:26:52 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630812.2426243, 446dc134-cae8-46b1-81db-da81488d6b56 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:26:52 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] VM Started (Lifecycle Event)
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Successfully created port: d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:26:52 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:26:52 user nova-compute[73029]: INFO nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:26:52 user nova-compute[73029]: INFO nova.compute.manager [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Took 19.75 seconds to build instance.
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-7b2f0e4f-19a6-41dc-99b4-4bc9b7881156 req-a642b48f-9b7e-4c9a-a0df-31b9c12c89af service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received event network-vif-plugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7b2f0e4f-19a6-41dc-99b4-4bc9b7881156 req-a642b48f-9b7e-4c9a-a0df-31b9c12c89af service nova] Acquiring lock "446dc134-cae8-46b1-81db-da81488d6b56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7b2f0e4f-19a6-41dc-99b4-4bc9b7881156 req-a642b48f-9b7e-4c9a-a0df-31b9c12c89af service nova] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7b2f0e4f-19a6-41dc-99b4-4bc9b7881156 req-a642b48f-9b7e-4c9a-a0df-31b9c12c89af service nova] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:26:52 user nova-compute[73029]: DEBUG nova.compute.manager [req-7b2f0e4f-19a6-41dc-99b4-4bc9b7881156 req-a642b48f-9b7e-4c9a-a0df-31b9c12c89af service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] No waiting events found dispatching network-vif-plugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:26:52 user nova-compute[73029]: WARNING nova.compute.manager [req-7b2f0e4f-19a6-41dc-99b4-4bc9b7881156 req-a642b48f-9b7e-4c9a-a0df-31b9c12c89af service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received unexpected event network-vif-plugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 for instance with vm_state active and task_state None.
Aug 10 01:26:52 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-dd60ace3-febe-4704-a62e-0fc562aa5dae tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "446dc134-cae8-46b1-81db-da81488d6b56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.918s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Successfully updated port: d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquired lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-65801ac9-0cf3-4c32-a01f-647edd54ecf7 req-d54e8763-d5da-4cd8-b797-3c735bf18ca0 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-65801ac9-0cf3-4c32-a01f-647edd54ecf7 req-d54e8763-d5da-4cd8-b797-3c735bf18ca0 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing instance network info cache due to event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-65801ac9-0cf3-4c32-a01f-647edd54ecf7 req-d54e8763-d5da-4cd8-b797-3c735bf18ca0 service nova] Acquiring lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Releasing lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Instance network_info: |[{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-65801ac9-0cf3-4c32-a01f-647edd54ecf7 req-d54e8763-d5da-4cd8-b797-3c735bf18ca0 service nova] Acquired lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG nova.network.neutron [req-65801ac9-0cf3-4c32-a01f-647edd54ecf7 req-d54e8763-d5da-4cd8-b797-3c735bf18ca0 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:26:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:26:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-65801ac9-0cf3-4c32-a01f-647edd54ecf7 req-d54e8763-d5da-4cd8-b797-3c735bf18ca0 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updated VIF entry in instance network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:26:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-65801ac9-0cf3-4c32-a01f-647edd54ecf7 req-d54e8763-d5da-4cd8-b797-3c735bf18ca0 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:26:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-65801ac9-0cf3-4c32-a01f-647edd54ecf7 req-d54e8763-d5da-4cd8-b797-3c735bf18ca0 service nova] Releasing lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:26:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:26:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:26:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:26:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:26:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:26:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:27:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Creating image(s)
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Ensure instance console log exists: /opt/stack/data/nova/instances/49412620-3fa6-4ed8-becf-4adaa554a52d/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Start _get_guest_xml network_info=[{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '8786668d-ef62-44f2-a77f-46a1a0042bb7', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRITWaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49412620-3fa6-4ed8-becf-4adaa554a52d', 'attached_at': '', 'detached_at': '', 'volume_id': '870df3e1-71ee-4d96-b3f2-b62a42a69e8a', 'serial': '870df3e1-71ee-4d96-b3f2-b62a42a69e8a'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:27:00 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:27:00 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRITWaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:27:00 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:27:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:27:00 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:27:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:27:00 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb60ac69-7fb0-417b-a1c6-651ae033084a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:27:00 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7997f7-d1d8-48de-8ffa-656acf934bc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a] added
Aug 10 01:27:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c94ba1-1b1a-452a-b2a3-88f41a408933]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[745bbbc9-39b7-41b6-8463-dc593b6bf1bc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:27:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcRITWaO {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcRITWaO" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e667d6-c5b0-4d31-bdfa-abd51a50b13d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcRITWaO'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd2f56-d7b6-4f22-a4fd-c828620826a9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99154e8-959d-4606-9aac-8a6715b558f8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)
Aug 10 01:27:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)
Aug 10 01:27:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cb5a59-fce9-448c-971e-f7d6509f3639]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260]
Aug 10 01:27:01 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260] successful.
Aug 10 01:27:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6375a50f-09f4-4cd7-ba88-16882624de8c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2fd51f-63e0-4de2-8a0a-28eab535b136]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)
Aug 10 01:27:01 user nova-compute[73029]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:27:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)
Aug 10 01:27:01 user nova-compute[73029]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:27:01 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4bed92-77ae-4970-9781-949ae623e87d]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:27:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRITWaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23438343465373763', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438343465373763', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-431804702',display_name='tempest-TestShelveInstance-server-431804702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-431804702',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV8vLVb8lS4XmOQNCAPTyWEXaT+dXAV2KyTR3VoGPMFC9ZsEDz0ZEBVVBknGOssGkhH+J4KgCPVCcfe1Ex8sNeU4PknHYOyUr7AtjaoMHOIeTeB/nqX1v7emjQRXmrz8w==',key_name='tempest-TestShelveInstance-888846196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2819848c56e4be7a3ef09731134a75c',ramdisk_id='',reservation_id='r-sq5zk7b0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-353939251',owner_user_name='tempest-TestShelveInstance-353939251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:26:52Z,user_data=None,user_id='ae1f274d3b714262bd06fde868b55aba',uuid=49412620-3fa6-4ed8-becf-4adaa554a52d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converting VIF {"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lazy-loading 'pci_devices' on Instance uuid 49412620-3fa6-4ed8-becf-4adaa554a52d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:27:02 user nova-compute[73029]:   <uuid>49412620-3fa6-4ed8-becf-4adaa554a52d</uuid>
Aug 10 01:27:02 user nova-compute[73029]:   <name>instance-0000002c</name>
Aug 10 01:27:02 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:27:02 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:27:02 user nova-compute[73029]:   <metadata>
Aug 10 01:27:02 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:27:02 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:27:02 user nova-compute[73029]:       <nova:name>tempest-TestShelveInstance-server-431804702</nova:name>
Aug 10 01:27:02 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:27:00</nova:creationTime>
Aug 10 01:27:02 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:27:02 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:27:02 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:27:02 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:27:02 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:27:02 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:27:02 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:27:02 user nova-compute[73029]:       <nova:owner>
Aug 10 01:27:02 user nova-compute[73029]:         <nova:user uuid="ae1f274d3b714262bd06fde868b55aba">tempest-TestShelveInstance-353939251-project-member</nova:user>
Aug 10 01:27:02 user nova-compute[73029]:         <nova:project uuid="d2819848c56e4be7a3ef09731134a75c">tempest-TestShelveInstance-353939251</nova:project>
Aug 10 01:27:02 user nova-compute[73029]:       </nova:owner>
Aug 10 01:27:02 user nova-compute[73029]:       <nova:ports>
Aug 10 01:27:02 user nova-compute[73029]:         <nova:port uuid="d0f035cd-ed95-410b-970a-3fc1c59ed421">
Aug 10 01:27:02 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 01:27:02 user nova-compute[73029]:         </nova:port>
Aug 10 01:27:02 user nova-compute[73029]:       </nova:ports>
Aug 10 01:27:02 user nova-compute[73029]:     </nova:instance>
Aug 10 01:27:02 user nova-compute[73029]:   </metadata>
Aug 10 01:27:02 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:27:02 user nova-compute[73029]:     <system>
Aug 10 01:27:02 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:27:02 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:27:02 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:27:02 user nova-compute[73029]:       <entry name="serial">49412620-3fa6-4ed8-becf-4adaa554a52d</entry>
Aug 10 01:27:02 user nova-compute[73029]:       <entry name="uuid">49412620-3fa6-4ed8-becf-4adaa554a52d</entry>
Aug 10 01:27:02 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:27:02 user nova-compute[73029]:     </system>
Aug 10 01:27:02 user nova-compute[73029]:   </sysinfo>
Aug 10 01:27:02 user nova-compute[73029]:   <os>
Aug 10 01:27:02 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:27:02 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:27:02 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:27:02 user nova-compute[73029]:   </os>
Aug 10 01:27:02 user nova-compute[73029]:   <features>
Aug 10 01:27:02 user nova-compute[73029]:     <acpi/>
Aug 10 01:27:02 user nova-compute[73029]:     <apic/>
Aug 10 01:27:02 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:27:02 user nova-compute[73029]:   </features>
Aug 10 01:27:02 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:27:02 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:27:02 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:27:02 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:27:02 user nova-compute[73029]:   </clock>
Aug 10 01:27:02 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:27:02 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:27:02 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:27:02 user nova-compute[73029]:   </cpu>
Aug 10 01:27:02 user nova-compute[73029]:   <devices>
Aug 10 01:27:02 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:27:02 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:27:02 user nova-compute[73029]:       <source dev="/dev/sdc"/>
Aug 10 01:27:02 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:27:02 user nova-compute[73029]:       <serial>870df3e1-71ee-4d96-b3f2-b62a42a69e8a</serial>
Aug 10 01:27:02 user nova-compute[73029]:     </disk>
Aug 10 01:27:02 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:27:02 user nova-compute[73029]:       <mac address="fa:16:3e:15:6c:d2"/>
Aug 10 01:27:02 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:27:02 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:27:02 user nova-compute[73029]:       <target dev="tapd0f035cd-ed"/>
Aug 10 01:27:02 user nova-compute[73029]:     </interface>
Aug 10 01:27:02 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:27:02 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/49412620-3fa6-4ed8-becf-4adaa554a52d/console.log" append="off"/>
Aug 10 01:27:02 user nova-compute[73029]:     </serial>
Aug 10 01:27:02 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:27:02 user nova-compute[73029]:     <video>
Aug 10 01:27:02 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:27:02 user nova-compute[73029]:     </video>
Aug 10 01:27:02 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:27:02 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:27:02 user nova-compute[73029]:     </rng>
Aug 10 01:27:02 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:27:02 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:27:02 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:27:02 user nova-compute[73029]:     </memballoon>
Aug 10 01:27:02 user nova-compute[73029]:   </devices>
Aug 10 01:27:02 user nova-compute[73029]: </domain>
Aug 10 01:27:02 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-431804702',display_name='tempest-TestShelveInstance-server-431804702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-431804702',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV8vLVb8lS4XmOQNCAPTyWEXaT+dXAV2KyTR3VoGPMFC9ZsEDz0ZEBVVBknGOssGkhH+J4KgCPVCcfe1Ex8sNeU4PknHYOyUr7AtjaoMHOIeTeB/nqX1v7emjQRXmrz8w==',key_name='tempest-TestShelveInstance-888846196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2819848c56e4be7a3ef09731134a75c',ramdisk_id='',reservation_id='r-sq5zk7b0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-353939251',owner_user_name='tempest-TestShelveInstance-353939251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:26:52Z,user_data=None,user_id='ae1f274d3b714262bd06fde868b55aba',uuid=49412620-3fa6-4ed8-becf-4adaa554a52d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converting VIF {"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG os_vif [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0f035cd-ed, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0f035cd-ed, col_values=(('external_ids', {'iface-id': 'd0f035cd-ed95-410b-970a-3fc1c59ed421', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:6c:d2', 'vm-uuid': '49412620-3fa6-4ed8-becf-4adaa554a52d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:02 user nova-compute[73029]: INFO os_vif [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed')
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:27:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] No VIF found with MAC fa:16:3e:15:6c:d2, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:27:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:03 user nova-compute[73029]: DEBUG nova.compute.manager [req-c1e6f8bd-241f-4f67-b49f-f164e3b5756a req-d8a284cc-1a1f-4947-8003-a997cc435d1e service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:27:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c1e6f8bd-241f-4f67-b49f-f164e3b5756a req-d8a284cc-1a1f-4947-8003-a997cc435d1e service nova] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:27:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c1e6f8bd-241f-4f67-b49f-f164e3b5756a req-d8a284cc-1a1f-4947-8003-a997cc435d1e service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:27:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c1e6f8bd-241f-4f67-b49f-f164e3b5756a req-d8a284cc-1a1f-4947-8003-a997cc435d1e service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:27:03 user nova-compute[73029]: DEBUG nova.compute.manager [req-c1e6f8bd-241f-4f67-b49f-f164e3b5756a req-d8a284cc-1a1f-4947-8003-a997cc435d1e service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] No waiting events found dispatching network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:27:03 user nova-compute[73029]: WARNING nova.compute.manager [req-c1e6f8bd-241f-4f67-b49f-f164e3b5756a req-d8a284cc-1a1f-4947-8003-a997cc435d1e service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received unexpected event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 for instance with vm_state building and task_state spawning.
Aug 10 01:27:04 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Skipping network cache update for instance because it is Building. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 446dc134-cae8-46b1-81db-da81488d6b56 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updating instance_info_cache with network_info: [{"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:27:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630825.6249044, 49412620-3fa6-4ed8-becf-4adaa554a52d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:27:05 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] VM Resumed (Lifecycle Event)
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:27:05 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Instance spawned successfully.
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:27:05 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630825.626615, 49412620-3fa6-4ed8-becf-4adaa554a52d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:27:05 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] VM Started (Lifecycle Event)
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-b8d0cfa2-058d-452f-9914-a56b297572b3 req-bcf31026-592f-4ad2-b020-db3044b813d0 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b8d0cfa2-058d-452f-9914-a56b297572b3 req-bcf31026-592f-4ad2-b020-db3044b813d0 service nova] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b8d0cfa2-058d-452f-9914-a56b297572b3 req-bcf31026-592f-4ad2-b020-db3044b813d0 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b8d0cfa2-058d-452f-9914-a56b297572b3 req-bcf31026-592f-4ad2-b020-db3044b813d0 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.compute.manager [req-b8d0cfa2-058d-452f-9914-a56b297572b3 req-bcf31026-592f-4ad2-b020-db3044b813d0 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] No waiting events found dispatching network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:27:05 user nova-compute[73029]: WARNING nova.compute.manager [req-b8d0cfa2-058d-452f-9914-a56b297572b3 req-bcf31026-592f-4ad2-b020-db3044b813d0 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received unexpected event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 for instance with vm_state building and task_state spawning.
Aug 10 01:27:05 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:27:05 user nova-compute[73029]: INFO nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 10 01:27:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:27:05 user nova-compute[73029]: INFO nova.compute.manager [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Took 14.76 seconds to build instance.
Aug 10 01:27:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4fc1da38-69d8-4e04-84cb-15ab6dec3a70 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.906s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:27:06 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:27:06 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=25.08132553100586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 446dc134-cae8-46b1-81db-da81488d6b56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 49412620-3fa6-4ed8-becf-4adaa554a52d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:27:06 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:27:07 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:27:07 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:27:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:27:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:09 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:27:09 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:27:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:27:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:27:55 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:27:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:27:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:27:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:27:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:27:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:27:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:01 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:28:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 446dc134-cae8-46b1-81db-da81488d6b56 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updating instance_info_cache with network_info: [{"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-446dc134-cae8-46b1-81db-da81488d6b56" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:28:04 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:28:05 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:28:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:28:08 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:28:08 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=25.080543518066406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 446dc134-cae8-46b1-81db-da81488d6b56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 49412620-3fa6-4ed8-becf-4adaa554a52d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:28:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:28:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:28:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "446dc134-cae8-46b1-81db-da81488d6b56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "446dc134-cae8-46b1-81db-da81488d6b56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "446dc134-cae8-46b1-81db-da81488d6b56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:23 user nova-compute[73029]: INFO nova.compute.manager [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Terminating instance
Aug 10 01:28:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-e7bd2a52-01dd-4abf-8c7d-55c4a42c0745 req-265dbe76-8ce4-46ab-9ec3-7a9fb849f429 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received event network-vif-unplugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e7bd2a52-01dd-4abf-8c7d-55c4a42c0745 req-265dbe76-8ce4-46ab-9ec3-7a9fb849f429 service nova] Acquiring lock "446dc134-cae8-46b1-81db-da81488d6b56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e7bd2a52-01dd-4abf-8c7d-55c4a42c0745 req-265dbe76-8ce4-46ab-9ec3-7a9fb849f429 service nova] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e7bd2a52-01dd-4abf-8c7d-55c4a42c0745 req-265dbe76-8ce4-46ab-9ec3-7a9fb849f429 service nova] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-e7bd2a52-01dd-4abf-8c7d-55c4a42c0745 req-265dbe76-8ce4-46ab-9ec3-7a9fb849f429 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] No waiting events found dispatching network-vif-unplugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:28:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-e7bd2a52-01dd-4abf-8c7d-55c4a42c0745 req-265dbe76-8ce4-46ab-9ec3-7a9fb849f429 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received event network-vif-unplugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Instance destroyed successfully.
Aug 10 01:28:24 user nova-compute[73029]: DEBUG nova.objects.instance [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'resources' on Instance uuid 446dc134-cae8-46b1-81db-da81488d6b56 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-653842291',display_name='tempest-TestVolumeBootPattern-server-653842291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-653842291',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:26:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-m4s8foua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:26:53Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=446dc134-cae8-46b1-81db-da81488d6b56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "address": "fa:16:3e:7c:b8:af", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92959eff-af", "ovs_interfaceid": "92959eff-af4b-43a8-88ae-36b2dfe98cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=92959eff-af4b-43a8-88ae-36b2dfe98cc2,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92959eff-af') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_vif [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=92959eff-af4b-43a8-88ae-36b2dfe98cc2,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92959eff-af') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92959eff-af, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:28:24 user nova-compute[73029]: INFO os_vif [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=92959eff-af4b-43a8-88ae-36b2dfe98cc2,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92959eff-af')
Aug 10 01:28:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUMfckiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:28:24 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac40a019-3ab4-43c7-b6b6-8cdf44a0f044]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bbab36-730a-4f33-8810-7891512afb82]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)
Aug 10 01:28:24 user nova-compute[73029]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:28:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff (non-flash)
Aug 10 01:28:24 user nova-compute[73029]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:28:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751411bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[492e45a6-d456-4d0f-ad5d-e94bf1967ebf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bec741-f2c0-43f5-8cd6-ada8722cc76c]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc4c167-05e0-4c81-916a-c8c6208ca32a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2afadc-17b5-4f5d-91ba-859045a9d5f7]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c0fddeae', '/dev/disk/by-id/scsi-26235613339653536', '/dev/disk/by-id/scsi-1SCST_BIOc0fddeae-b5a39e566431452c') {{(pid=84041) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a825768-55e8-49cc-84e1-619dbbdc795a]: (4, None) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc59775-4f0f-4367-919a-3d91455a3299]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d7bd37-cdff-4216-9901-bffe9b5bc7ff]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff, portal: 172.16.0.220,3260]
Aug 10 01:28:24 user nova-compute[73029]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff, portal: 172.16.0.220,3260] successful.
Aug 10 01:28:24 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cb6e30-f7f6-4324-9fa6-2511bfcafbff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66c6fdd-81aa-4f1b-8be7-673170e14236]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== disconnect_volume: return (289ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:28:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Deleting instance files /opt/stack/data/nova/instances/446dc134-cae8-46b1-81db-da81488d6b56_del
Aug 10 01:28:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Deletion of /opt/stack/data/nova/instances/446dc134-cae8-46b1-81db-da81488d6b56_del complete
Aug 10 01:28:24 user nova-compute[73029]: INFO nova.compute.manager [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 10 01:28:24 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:28:24 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:28:25 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:28:25 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Took 0.57 seconds to deallocate network for instance.
Aug 10 01:28:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-1c7d11b8-f83e-4793-a6b7-e5317317290b req-3f8acbb6-8f5a-4acc-9b90-69ae26bd734f service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received event network-vif-deleted-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:28:25 user nova-compute[73029]: INFO nova.compute.manager [req-1c7d11b8-f83e-4793-a6b7-e5317317290b req-3f8acbb6-8f5a-4acc-9b90-69ae26bd734f service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Neutron deleted interface 92959eff-af4b-43a8-88ae-36b2dfe98cc2; detaching it from the instance and deleting it from the info cache
Aug 10 01:28:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-1c7d11b8-f83e-4793-a6b7-e5317317290b req-3f8acbb6-8f5a-4acc-9b90-69ae26bd734f service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:28:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-1c7d11b8-f83e-4793-a6b7-e5317317290b req-3f8acbb6-8f5a-4acc-9b90-69ae26bd734f service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Detach interface failed, port_id=92959eff-af4b-43a8-88ae-36b2dfe98cc2, reason: Instance 446dc134-cae8-46b1-81db-da81488d6b56 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 01:28:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-e1fa3e0e-8326-432c-9ec5-62cd2381dcdb req-ae959d86-8bc5-47a8-a27b-455ccd7a9413 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received event network-vif-plugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:28:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e1fa3e0e-8326-432c-9ec5-62cd2381dcdb req-ae959d86-8bc5-47a8-a27b-455ccd7a9413 service nova] Acquiring lock "446dc134-cae8-46b1-81db-da81488d6b56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e1fa3e0e-8326-432c-9ec5-62cd2381dcdb req-ae959d86-8bc5-47a8-a27b-455ccd7a9413 service nova] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e1fa3e0e-8326-432c-9ec5-62cd2381dcdb req-ae959d86-8bc5-47a8-a27b-455ccd7a9413 service nova] Lock "446dc134-cae8-46b1-81db-da81488d6b56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-e1fa3e0e-8326-432c-9ec5-62cd2381dcdb req-ae959d86-8bc5-47a8-a27b-455ccd7a9413 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] No waiting events found dispatching network-vif-plugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:28:25 user nova-compute[73029]: WARNING nova.compute.manager [req-e1fa3e0e-8326-432c-9ec5-62cd2381dcdb req-ae959d86-8bc5-47a8-a27b-455ccd7a9413 service nova] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Received unexpected event network-vif-plugged-92959eff-af4b-43a8-88ae-36b2dfe98cc2 for instance with vm_state active and task_state deleting.
Aug 10 01:28:25 user nova-compute[73029]: INFO nova.compute.manager [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Took 0.71 seconds to detach 1 volumes for instance.
Aug 10 01:28:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Deleting volume: 86cb6e30-f7f6-4324-9fa6-2511bfcafbff {{(pid=73029) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 10 01:28:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:26 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:28:26 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:28:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:26 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Deleted allocations for instance 446dc134-cae8-46b1-81db-da81488d6b56
Aug 10 01:28:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-182f000a-06a1-4c64-8a96-200e74769b6c tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "446dc134-cae8-46b1-81db-da81488d6b56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.758s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:39 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691630904.2645729, 446dc134-cae8-46b1-81db-da81488d6b56 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:28:39 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] VM Stopped (Lifecycle Event)
Aug 10 01:28:39 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e4dfca85-ff7d-449a-9585-3db6dc46266d None None] [instance: 446dc134-cae8-46b1-81db-da81488d6b56] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:28:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-f732400a-fab4-40c8-8baa-e3229f0b40d1 req-4f919858-01e1-4eb6-b2c4-127748d1c185 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG nova.compute.manager [req-f732400a-fab4-40c8-8baa-e3229f0b40d1 req-4f919858-01e1-4eb6-b2c4-127748d1c185 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing instance network info cache due to event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f732400a-fab4-40c8-8baa-e3229f0b40d1 req-4f919858-01e1-4eb6-b2c4-127748d1c185 service nova] Acquiring lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f732400a-fab4-40c8-8baa-e3229f0b40d1 req-4f919858-01e1-4eb6-b2c4-127748d1c185 service nova] Acquired lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG nova.network.neutron [req-f732400a-fab4-40c8-8baa-e3229f0b40d1 req-4f919858-01e1-4eb6-b2c4-127748d1c185 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:43 user nova-compute[73029]: INFO nova.compute.manager [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Shelve offloading
Aug 10 01:28:43 user nova-compute[73029]: DEBUG nova.network.neutron [req-f732400a-fab4-40c8-8baa-e3229f0b40d1 req-4f919858-01e1-4eb6-b2c4-127748d1c185 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updated VIF entry in instance network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG nova.network.neutron [req-f732400a-fab4-40c8-8baa-e3229f0b40d1 req-4f919858-01e1-4eb6-b2c4-127748d1c185 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-f732400a-fab4-40c8-8baa-e3229f0b40d1 req-4f919858-01e1-4eb6-b2c4-127748d1c185 service nova] Releasing lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:28:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:44 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Instance destroyed successfully.
Aug 10 01:28:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:28:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:28:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquired lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:28:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-unplugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] No waiting events found dispatching network-vif-unplugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:28:45 user nova-compute[73029]: WARNING nova.compute.manager [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received unexpected event network-vif-unplugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 for instance with vm_state active and task_state shelving.
Aug 10 01:28:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] No waiting events found dispatching network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:28:45 user nova-compute[73029]: WARNING nova.compute.manager [req-0120d0b9-b06a-4c65-9333-8b177e079d51 req-af323b94-5fd1-4358-af3d-1724172894d7 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received unexpected event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 for instance with vm_state active and task_state shelving.
Aug 10 01:28:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:28:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Releasing lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:28:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Instance destroyed successfully.
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lazy-loading 'resources' on Instance uuid 49412620-3fa6-4ed8-becf-4adaa554a52d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-431804702',display_name='tempest-TestShelveInstance-server-431804702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-431804702',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV8vLVb8lS4XmOQNCAPTyWEXaT+dXAV2KyTR3VoGPMFC9ZsEDz0ZEBVVBknGOssGkhH+J4KgCPVCcfe1Ex8sNeU4PknHYOyUr7AtjaoMHOIeTeB/nqX1v7emjQRXmrz8w==',key_name='tempest-TestShelveInstance-888846196',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2819848c56e4be7a3ef09731134a75c',ramdisk_id='',reservation_id='r-sq5zk7b0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-353939251',owner_user_name='tempest-TestShelveInstance-353939251-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:27:06Z,user_data=None,user_id='ae1f274d3b714262bd06fde868b55aba',uuid=49412620-3fa6-4ed8-becf-4adaa554a52d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converting VIF {"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_vif [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0f035cd-ed, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:28:46 user nova-compute[73029]: INFO os_vif [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed')
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-68c288e7-9d91-4a24-8574-ad5be8024ae8 req-5eed0d72-263e-4160-9092-1e6625ef1022 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-68c288e7-9d91-4a24-8574-ad5be8024ae8 req-5eed0d72-263e-4160-9092-1e6625ef1022 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing instance network info cache due to event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-68c288e7-9d91-4a24-8574-ad5be8024ae8 req-5eed0d72-263e-4160-9092-1e6625ef1022 service nova] Acquiring lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-68c288e7-9d91-4a24-8574-ad5be8024ae8 req-5eed0d72-263e-4160-9092-1e6625ef1022 service nova] Acquired lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.network.neutron [req-68c288e7-9d91-4a24-8574-ad5be8024ae8 req-5eed0d72-263e-4160-9092-1e6625ef1022 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRITWaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:28:46 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[80695c52-1070-44d3-9dd7-fc1a6be1168c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d187d4-1622-4b6a-b73f-a011fcad7a73]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:28:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:28:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f0741e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ac53d5-5c0f-46f5-8763-cc98a0d402eb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aa6f09-2add-4748-85a0-4737825670cb]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e91d16-e0fd-436d-9a82-b8e80ba99ae7]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa41a23-b0a9-4f1e-a09a-ec8f396fa11e]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[730048d0-7773-450a-8f59-cc2c2fd690b3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.038s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9788c8f-c70c-4a10-92d0-fee4c6215ce6]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260]
Aug 10 01:28:46 user nova-compute[73029]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260] successful.
Aug 10 01:28:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d32517e-c05a-4b3e-acbf-d0f0967e562d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] <== disconnect_volume: return (252ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:28:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Deleting instance files /opt/stack/data/nova/instances/49412620-3fa6-4ed8-becf-4adaa554a52d_del
Aug 10 01:28:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Deletion of /opt/stack/data/nova/instances/49412620-3fa6-4ed8-becf-4adaa554a52d_del complete
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.network.neutron [req-68c288e7-9d91-4a24-8574-ad5be8024ae8 req-5eed0d72-263e-4160-9092-1e6625ef1022 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updated VIF entry in instance network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG nova.network.neutron [req-68c288e7-9d91-4a24-8574-ad5be8024ae8 req-5eed0d72-263e-4160-9092-1e6625ef1022 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": null, "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:28:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-68c288e7-9d91-4a24-8574-ad5be8024ae8 req-5eed0d72-263e-4160-9092-1e6625ef1022 service nova] Releasing lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:28:47 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Deleted allocations for instance 49412620-3fa6-4ed8-becf-4adaa554a52d
Aug 10 01:28:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:28:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:28:47 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lazy-loading 'numa_topology' on Instance uuid 49412620-3fa6-4ed8-becf-4adaa554a52d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:28:47 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:28:47 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:28:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.097s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:47 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2150a4fa-41f5-4423-9935-3d85873e7bdc tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.854s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:28:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:55 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:28:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:28:59 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691630924.6474795, 49412620-3fa6-4ed8-becf-4adaa554a52d => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:28:59 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] VM Stopped (Lifecycle Event)
Aug 10 01:28:59 user nova-compute[73029]: DEBUG nova.compute.manager [None req-24d65d43-2cd4-44b3-908a-ecc62c6aaae6 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:29:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:29:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:29:04 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:29:08 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:29:08 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:29:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=25.079479217529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:29:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:29:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:29:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:29:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:29:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:29:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:29:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:29:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:29:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:29:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:29:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:29:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:29:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:29:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:29:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:29:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:29:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:29:34 user nova-compute[73029]: INFO nova.compute.claims [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Claim successful on node user
Aug 10 01:29:34 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:29:34 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.173s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:29:35 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:29:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:29:35 user nova-compute[73029]: INFO nova.virt.block_device [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Booting with volume d8a47efa-4dab-45c6-98a0-857046e841a2 at /dev/vda
Aug 10 01:29:35 user nova-compute[73029]: DEBUG nova.policy [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44698a7ae911479eb2d5d8a8103ac5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b217381b301d4650bc046a0031d044a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG os_brick.utils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b687359e-afa8-4a66-8651-358d17d28d3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d88af6-ba7a-41b4-8e2b-a0a92df5b04b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf8dba-7d8d-4363-b6cf-71d710d00cdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[125832f6-06e1-4a08-83c8-6a03033accd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:29:35 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:29:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe31898-68cb-46b6-8235-c9e5ef822a89]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG os_brick.utils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updating existing volume attachment record: 744c6ab8-b5b3-4143-835a-15c9423bc36b {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:29:35 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Successfully created port: 6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Successfully updated port: 6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquired lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-79677866-dc23-43d6-9ef2-3b689eefb769 req-a6c91159-5325-4f47-9935-4b6635cc70a3 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received event network-changed-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-79677866-dc23-43d6-9ef2-3b689eefb769 req-a6c91159-5325-4f47-9935-4b6635cc70a3 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Refreshing instance network info cache due to event network-changed-6b13c3a6-38a9-4943-87bb-1e9a2db38da7. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-79677866-dc23-43d6-9ef2-3b689eefb769 req-a6c91159-5325-4f47-9935-4b6635cc70a3 service nova] Acquiring lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:29:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updating instance_info_cache with network_info: [{"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:29:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Releasing lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:29:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Instance network_info: |[{"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:29:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-79677866-dc23-43d6-9ef2-3b689eefb769 req-a6c91159-5325-4f47-9935-4b6635cc70a3 service nova] Acquired lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:29:37 user nova-compute[73029]: DEBUG nova.network.neutron [req-79677866-dc23-43d6-9ef2-3b689eefb769 req-a6c91159-5325-4f47-9935-4b6635cc70a3 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Refreshing network info cache for port 6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:29:37 user nova-compute[73029]: DEBUG nova.network.neutron [req-79677866-dc23-43d6-9ef2-3b689eefb769 req-a6c91159-5325-4f47-9935-4b6635cc70a3 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updated VIF entry in instance network info cache for port 6b13c3a6-38a9-4943-87bb-1e9a2db38da7. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:29:37 user nova-compute[73029]: DEBUG nova.network.neutron [req-79677866-dc23-43d6-9ef2-3b689eefb769 req-a6c91159-5325-4f47-9935-4b6635cc70a3 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updating instance_info_cache with network_info: [{"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:29:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-79677866-dc23-43d6-9ef2-3b689eefb769 req-a6c91159-5325-4f47-9935-4b6635cc70a3 service nova] Releasing lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:29:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:29:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:29:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:29:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:29:43 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Creating image(s)
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Ensure instance console log exists: /opt/stack/data/nova/instances/164e6c98-8a6e-43b3-a5f7-b796a82126bb/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Start _get_guest_xml network_info=[{"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '744c6ab8-b5b3-4143-835a-15c9423bc36b', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glcLfdnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '164e6c98-8a6e-43b3-a5f7-b796a82126bb', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8a47efa-4dab-45c6-98a0-857046e841a2', 'serial': 'd8a47efa-4dab-45c6-98a0-857046e841a2'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:29:43 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:29:43 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:29:43 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glcLfdnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:29:44 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:29:44 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:29:44 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[504a59a6-189d-4eb8-bacb-2de2c4460d9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:29:44 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfb464e-9c44-4b30-8384-b3aac1324a9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2] added
Aug 10 01:29:44 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[301a7fb5-a58b-4b5a-833f-6f8a073c82a5]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21c5431-8bfa-42da-8998-1c5dd2b3f277]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glcLfdnv {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glcLfdnv" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f78b6fe-2193-4904-ab37-dcb933f84791]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'glcLfdnv'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab8db2-b61b-4af1-bbff-6066bddaca7c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7aa057-5307-4a96-98d8-9f0621293d7b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:29:44 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:29:44 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:29:44 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:29:44 user nova-compute[73029]: 
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf24516-d819-4445-a753-4a05838c2d0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2, portal: 172.16.0.220,3260]
Aug 10 01:29:44 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2, portal: 172.16.0.220,3260] successful.
Aug 10 01:29:44 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c300df-7532-4846-b9a7-9541a6312e1a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f014fed-c958-43d9-ab42-01eaa482e1cf]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:29:44 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:29:44 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf9dc9f-0812-48c9-9aeb-06523cf24408]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:29:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glcLfdnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26261663035663565', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261663035663565', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1589801589',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1589801589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1589801589',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI2Dob9ZbLxA/zX97v4B++84lsPYubGdpfTA2XnZejev5C4nV4ltdYAjojJu14M84IDBpO60u2G55gNZv1FVda7f4yo0R7ufjzBKpaRqsyRTy83wITiKbkishp/MSqiUA==',key_name='tempest-keypair-2083881660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-e9m4ebzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:29:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=164e6c98-8a6e-43b3-a5f7-b796a82126bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:2c:49,bridge_name='br-int',has_traffic_filtering=True,id=6b13c3a6-38a9-4943-87bb-1e9a2db38da7,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13c3a6-38') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'pci_devices' on Instance uuid 164e6c98-8a6e-43b3-a5f7-b796a82126bb {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:29:45 user nova-compute[73029]:   <uuid>164e6c98-8a6e-43b3-a5f7-b796a82126bb</uuid>
Aug 10 01:29:45 user nova-compute[73029]:   <name>instance-0000002d</name>
Aug 10 01:29:45 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:29:45 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:29:45 user nova-compute[73029]:   <metadata>
Aug 10 01:29:45 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:29:45 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:29:45 user nova-compute[73029]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1589801589</nova:name>
Aug 10 01:29:45 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:29:43</nova:creationTime>
Aug 10 01:29:45 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:29:45 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:29:45 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:29:45 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:29:45 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:29:45 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:29:45 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:29:45 user nova-compute[73029]:       <nova:owner>
Aug 10 01:29:45 user nova-compute[73029]:         <nova:user uuid="44698a7ae911479eb2d5d8a8103ac5dd">tempest-TestVolumeBootPattern-1870123799-project-member</nova:user>
Aug 10 01:29:45 user nova-compute[73029]:         <nova:project uuid="b217381b301d4650bc046a0031d044a7">tempest-TestVolumeBootPattern-1870123799</nova:project>
Aug 10 01:29:45 user nova-compute[73029]:       </nova:owner>
Aug 10 01:29:45 user nova-compute[73029]:       <nova:ports>
Aug 10 01:29:45 user nova-compute[73029]:         <nova:port uuid="6b13c3a6-38a9-4943-87bb-1e9a2db38da7">
Aug 10 01:29:45 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 10 01:29:45 user nova-compute[73029]:         </nova:port>
Aug 10 01:29:45 user nova-compute[73029]:       </nova:ports>
Aug 10 01:29:45 user nova-compute[73029]:     </nova:instance>
Aug 10 01:29:45 user nova-compute[73029]:   </metadata>
Aug 10 01:29:45 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:29:45 user nova-compute[73029]:     <system>
Aug 10 01:29:45 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:29:45 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:29:45 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:29:45 user nova-compute[73029]:       <entry name="serial">164e6c98-8a6e-43b3-a5f7-b796a82126bb</entry>
Aug 10 01:29:45 user nova-compute[73029]:       <entry name="uuid">164e6c98-8a6e-43b3-a5f7-b796a82126bb</entry>
Aug 10 01:29:45 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:29:45 user nova-compute[73029]:     </system>
Aug 10 01:29:45 user nova-compute[73029]:   </sysinfo>
Aug 10 01:29:45 user nova-compute[73029]:   <os>
Aug 10 01:29:45 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:29:45 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:29:45 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:29:45 user nova-compute[73029]:   </os>
Aug 10 01:29:45 user nova-compute[73029]:   <features>
Aug 10 01:29:45 user nova-compute[73029]:     <acpi/>
Aug 10 01:29:45 user nova-compute[73029]:     <apic/>
Aug 10 01:29:45 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:29:45 user nova-compute[73029]:   </features>
Aug 10 01:29:45 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:29:45 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:29:45 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:29:45 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:29:45 user nova-compute[73029]:   </clock>
Aug 10 01:29:45 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:29:45 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:29:45 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:29:45 user nova-compute[73029]:   </cpu>
Aug 10 01:29:45 user nova-compute[73029]:   <devices>
Aug 10 01:29:45 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:29:45 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:29:45 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 01:29:45 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:29:45 user nova-compute[73029]:       <serial>d8a47efa-4dab-45c6-98a0-857046e841a2</serial>
Aug 10 01:29:45 user nova-compute[73029]:     </disk>
Aug 10 01:29:45 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:29:45 user nova-compute[73029]:       <mac address="fa:16:3e:0f:2c:49"/>
Aug 10 01:29:45 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:29:45 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:29:45 user nova-compute[73029]:       <target dev="tap6b13c3a6-38"/>
Aug 10 01:29:45 user nova-compute[73029]:     </interface>
Aug 10 01:29:45 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:29:45 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/164e6c98-8a6e-43b3-a5f7-b796a82126bb/console.log" append="off"/>
Aug 10 01:29:45 user nova-compute[73029]:     </serial>
Aug 10 01:29:45 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:29:45 user nova-compute[73029]:     <video>
Aug 10 01:29:45 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:29:45 user nova-compute[73029]:     </video>
Aug 10 01:29:45 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:29:45 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:29:45 user nova-compute[73029]:     </rng>
Aug 10 01:29:45 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:29:45 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:29:45 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:29:45 user nova-compute[73029]:     </memballoon>
Aug 10 01:29:45 user nova-compute[73029]:   </devices>
Aug 10 01:29:45 user nova-compute[73029]: </domain>
Aug 10 01:29:45 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1589801589',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1589801589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1589801589',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI2Dob9ZbLxA/zX97v4B++84lsPYubGdpfTA2XnZejev5C4nV4ltdYAjojJu14M84IDBpO60u2G55gNZv1FVda7f4yo0R7ufjzBKpaRqsyRTy83wITiKbkishp/MSqiUA==',key_name='tempest-keypair-2083881660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-e9m4ebzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:29:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=164e6c98-8a6e-43b3-a5f7-b796a82126bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:2c:49,bridge_name='br-int',has_traffic_filtering=True,id=6b13c3a6-38a9-4943-87bb-1e9a2db38da7,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13c3a6-38') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG os_vif [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:2c:49,bridge_name='br-int',has_traffic_filtering=True,id=6b13c3a6-38a9-4943-87bb-1e9a2db38da7,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13c3a6-38') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b13c3a6-38, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b13c3a6-38, col_values=(('external_ids', {'iface-id': '6b13c3a6-38a9-4943-87bb-1e9a2db38da7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:2c:49', 'vm-uuid': '164e6c98-8a6e-43b3-a5f7-b796a82126bb'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:45 user nova-compute[73029]: INFO os_vif [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:2c:49,bridge_name='br-int',has_traffic_filtering=True,id=6b13c3a6-38a9-4943-87bb-1e9a2db38da7,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13c3a6-38')
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:29:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No VIF found with MAC fa:16:3e:0f:2c:49, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:29:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-4a11d85f-8e0e-48c9-b9eb-94febae5a8c6 req-e7d76edd-ce63-4785-afc1-a984591f710b service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received event network-vif-plugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:29:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4a11d85f-8e0e-48c9-b9eb-94febae5a8c6 req-e7d76edd-ce63-4785-afc1-a984591f710b service nova] Acquiring lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:29:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4a11d85f-8e0e-48c9-b9eb-94febae5a8c6 req-e7d76edd-ce63-4785-afc1-a984591f710b service nova] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:29:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4a11d85f-8e0e-48c9-b9eb-94febae5a8c6 req-e7d76edd-ce63-4785-afc1-a984591f710b service nova] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:29:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-4a11d85f-8e0e-48c9-b9eb-94febae5a8c6 req-e7d76edd-ce63-4785-afc1-a984591f710b service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] No waiting events found dispatching network-vif-plugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:29:46 user nova-compute[73029]: WARNING nova.compute.manager [req-4a11d85f-8e0e-48c9-b9eb-94febae5a8c6 req-e7d76edd-ce63-4785-afc1-a984591f710b service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received unexpected event network-vif-plugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 for instance with vm_state building and task_state spawning.
Aug 10 01:29:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630988.8446405, 164e6c98-8a6e-43b3-a5f7-b796a82126bb => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:29:48 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] VM Resumed (Lifecycle Event)
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:29:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Instance spawned successfully.
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-cfb1742a-9f0e-499b-bec8-a7eee6abad1a req-f6a00b8a-826d-4dd0-84a6-886818e38446 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received event network-vif-plugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cfb1742a-9f0e-499b-bec8-a7eee6abad1a req-f6a00b8a-826d-4dd0-84a6-886818e38446 service nova] Acquiring lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cfb1742a-9f0e-499b-bec8-a7eee6abad1a req-f6a00b8a-826d-4dd0-84a6-886818e38446 service nova] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cfb1742a-9f0e-499b-bec8-a7eee6abad1a req-f6a00b8a-826d-4dd0-84a6-886818e38446 service nova] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-cfb1742a-9f0e-499b-bec8-a7eee6abad1a req-f6a00b8a-826d-4dd0-84a6-886818e38446 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] No waiting events found dispatching network-vif-plugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:29:48 user nova-compute[73029]: WARNING nova.compute.manager [req-cfb1742a-9f0e-499b-bec8-a7eee6abad1a req-f6a00b8a-826d-4dd0-84a6-886818e38446 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received unexpected event network-vif-plugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 for instance with vm_state building and task_state spawning.
Aug 10 01:29:48 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691630988.8494017, 164e6c98-8a6e-43b3-a5f7-b796a82126bb => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:29:48 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] VM Started (Lifecycle Event)
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:29:48 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:29:48 user nova-compute[73029]: INFO nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 10 01:29:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:29:49 user nova-compute[73029]: INFO nova.compute.manager [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Took 14.26 seconds to build instance.
Aug 10 01:29:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-5adbfbb3-4024-4813-8557-2beb7f93e03b tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.363s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:29:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:29:55 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:29:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:30:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:05 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 164e6c98-8a6e-43b3-a5f7-b796a82126bb {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updating instance_info_cache with network_info: [{"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:30:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:07 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:30:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:10 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:30:10 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:30:10 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=25.077327728271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 164e6c98-8a6e-43b3-a5f7-b796a82126bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:30:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:30:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:30:35 user nova-compute[73029]: INFO nova.compute.manager [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Unshelving
Aug 10 01:30:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:35 user nova-compute[73029]: INFO nova.virt.block_device [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Booting with volume 870df3e1-71ee-4d96-b3f2-b62a42a69e8a at /dev/vda
Aug 10 01:30:35 user nova-compute[73029]: DEBUG os_brick.utils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad4c1d5-2ed1-48fb-93bf-fa37778994de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a412b591-2d08-407d-a0a8-1c33cadf6a62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc3f5fc-96d0-4bd6-a789-0f21fcadda32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c8936-b716-4c2c-b452-98e210d8c69a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:30:35 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:30:35 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c807a3-1e93-43ec-9530-456f617768fb]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG os_brick.utils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:30:35 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating existing volume attachment record: 7e976121-a3d8-4fb4-a993-37dde9de6d58 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:30:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:30:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:30:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:30:44 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lazy-loading 'pci_requests' on Instance uuid 49412620-3fa6-4ed8-becf-4adaa554a52d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:30:44 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lazy-loading 'numa_topology' on Instance uuid 49412620-3fa6-4ed8-becf-4adaa554a52d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:30:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:30:44 user nova-compute[73029]: INFO nova.compute.claims [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Claim successful on node user
Aug 10 01:30:44 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:30:44 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:30:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:30:44 user nova-compute[73029]: INFO nova.network.neutron [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating port d0f035cd-ed95-410b-970a-3fc1c59ed421 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 10 01:30:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquired lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-c8f17840-7d03-4a87-9fba-0a0e23e6f1f1 req-46558796-02e0-4f44-ac55-8ed3fcbcf49a service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-c8f17840-7d03-4a87-9fba-0a0e23e6f1f1 req-46558796-02e0-4f44-ac55-8ed3fcbcf49a service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing instance network info cache due to event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8f17840-7d03-4a87-9fba-0a0e23e6f1f1 req-46558796-02e0-4f44-ac55-8ed3fcbcf49a service nova] Acquiring lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.network.neutron [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Releasing lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:30:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Creating image(s)
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Ensure instance console log exists: /opt/stack/data/nova/instances/49412620-3fa6-4ed8-becf-4adaa554a52d/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Start _get_guest_xml network_info=[{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '7e976121-a3d8-4fb4-a993-37dde9de6d58', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRITWaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49412620-3fa6-4ed8-becf-4adaa554a52d', 'attached_at': '', 'detached_at': '', 'volume_id': '870df3e1-71ee-4d96-b3f2-b62a42a69e8a', 'serial': '870df3e1-71ee-4d96-b3f2-b62a42a69e8a'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8f17840-7d03-4a87-9fba-0a0e23e6f1f1 req-46558796-02e0-4f44-ac55-8ed3fcbcf49a service nova] Acquired lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.network.neutron [req-c8f17840-7d03-4a87-9fba-0a0e23e6f1f1 req-46558796-02e0-4f44-ac55-8ed3fcbcf49a service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:30:45 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:30:45 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lazy-loading 'vcpu_model' on Instance uuid 49412620-3fa6-4ed8-becf-4adaa554a52d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRITWaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:30:45 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:30:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:30:45 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:30:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:30:45 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace95c14-0c1c-40e7-be15-1698b9aa56a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:30:45 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[589318e0-dc45-406c-9a0e-b481a68916f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a] added
Aug 10 01:30:45 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4def96-41b7-4cbf-a4e7-df98337d654f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb8d5fe-fbe8-4ae0-b8c4-8331a4e7bef8]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:30:45 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcRITWaO {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcRITWaO" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e770abb8-12a1-43be-8a6e-5b124d9d302c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcRITWaO'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[76377823-033c-4633-b8b3-32eec70cfae8]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e6bcd8-133e-408e-9098-ece0754d19e0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:30:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:30:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f71c30-e6f6-4089-91f8-a261c4cd205e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260]
Aug 10 01:30:46 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260] successful.
Aug 10 01:30:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[85540384-b800-4d63-bedb-78b11e756f51]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade48410-7e40-4976-9b98-0e987ddaf80c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:30:46 user nova-compute[73029]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:30:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:30:46 user nova-compute[73029]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:30:46 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e112a1c2-b8e5-4b8c-9b20-89a2c5d7388e]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRITWaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG nova.network.neutron [req-c8f17840-7d03-4a87-9fba-0a0e23e6f1f1 req-46558796-02e0-4f44-ac55-8ed3fcbcf49a service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updated VIF entry in instance network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG nova.network.neutron [req-c8f17840-7d03-4a87-9fba-0a0e23e6f1f1 req-46558796-02e0-4f44-ac55-8ed3fcbcf49a service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:30:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8f17840-7d03-4a87-9fba-0a0e23e6f1f1 req-46558796-02e0-4f44-ac55-8ed3fcbcf49a service nova] Releasing lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23438343465373763', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438343465373763', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T01:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-431804702',display_name='tempest-TestShelveInstance-server-431804702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-431804702',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-888846196',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d2819848c56e4be7a3ef09731134a75c',ramdisk_id='',reservation_id='r-sq5zk7b0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-353939251',owner_user_name='tempest-TestShelveInstance-353939251-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:30:36Z,user_data=None,user_id='ae1f274d3b714262bd06fde868b55aba',uuid=49412620-3fa6-4ed8-becf-4adaa554a52d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converting VIF {"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.objects.instance [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lazy-loading 'pci_devices' on Instance uuid 49412620-3fa6-4ed8-becf-4adaa554a52d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:30:47 user nova-compute[73029]:   <uuid>49412620-3fa6-4ed8-becf-4adaa554a52d</uuid>
Aug 10 01:30:47 user nova-compute[73029]:   <name>instance-0000002c</name>
Aug 10 01:30:47 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:30:47 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:30:47 user nova-compute[73029]:   <metadata>
Aug 10 01:30:47 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:30:47 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:30:47 user nova-compute[73029]:       <nova:name>tempest-TestShelveInstance-server-431804702</nova:name>
Aug 10 01:30:47 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:30:45</nova:creationTime>
Aug 10 01:30:47 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:30:47 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:30:47 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:30:47 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:30:47 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:30:47 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:30:47 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:30:47 user nova-compute[73029]:       <nova:owner>
Aug 10 01:30:47 user nova-compute[73029]:         <nova:user uuid="ae1f274d3b714262bd06fde868b55aba">tempest-TestShelveInstance-353939251-project-member</nova:user>
Aug 10 01:30:47 user nova-compute[73029]:         <nova:project uuid="d2819848c56e4be7a3ef09731134a75c">tempest-TestShelveInstance-353939251</nova:project>
Aug 10 01:30:47 user nova-compute[73029]:       </nova:owner>
Aug 10 01:30:47 user nova-compute[73029]:       <nova:ports>
Aug 10 01:30:47 user nova-compute[73029]:         <nova:port uuid="d0f035cd-ed95-410b-970a-3fc1c59ed421">
Aug 10 01:30:47 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 01:30:47 user nova-compute[73029]:         </nova:port>
Aug 10 01:30:47 user nova-compute[73029]:       </nova:ports>
Aug 10 01:30:47 user nova-compute[73029]:     </nova:instance>
Aug 10 01:30:47 user nova-compute[73029]:   </metadata>
Aug 10 01:30:47 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:30:47 user nova-compute[73029]:     <system>
Aug 10 01:30:47 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:30:47 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:30:47 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:30:47 user nova-compute[73029]:       <entry name="serial">49412620-3fa6-4ed8-becf-4adaa554a52d</entry>
Aug 10 01:30:47 user nova-compute[73029]:       <entry name="uuid">49412620-3fa6-4ed8-becf-4adaa554a52d</entry>
Aug 10 01:30:47 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:30:47 user nova-compute[73029]:     </system>
Aug 10 01:30:47 user nova-compute[73029]:   </sysinfo>
Aug 10 01:30:47 user nova-compute[73029]:   <os>
Aug 10 01:30:47 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:30:47 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:30:47 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:30:47 user nova-compute[73029]:   </os>
Aug 10 01:30:47 user nova-compute[73029]:   <features>
Aug 10 01:30:47 user nova-compute[73029]:     <acpi/>
Aug 10 01:30:47 user nova-compute[73029]:     <apic/>
Aug 10 01:30:47 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:30:47 user nova-compute[73029]:   </features>
Aug 10 01:30:47 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:30:47 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:30:47 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:30:47 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:30:47 user nova-compute[73029]:   </clock>
Aug 10 01:30:47 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:30:47 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:30:47 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:30:47 user nova-compute[73029]:   </cpu>
Aug 10 01:30:47 user nova-compute[73029]:   <devices>
Aug 10 01:30:47 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:30:47 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:30:47 user nova-compute[73029]:       <source dev="/dev/sdc"/>
Aug 10 01:30:47 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:30:47 user nova-compute[73029]:       <serial>870df3e1-71ee-4d96-b3f2-b62a42a69e8a</serial>
Aug 10 01:30:47 user nova-compute[73029]:     </disk>
Aug 10 01:30:47 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:30:47 user nova-compute[73029]:       <mac address="fa:16:3e:15:6c:d2"/>
Aug 10 01:30:47 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:30:47 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:30:47 user nova-compute[73029]:       <target dev="tapd0f035cd-ed"/>
Aug 10 01:30:47 user nova-compute[73029]:     </interface>
Aug 10 01:30:47 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:30:47 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/49412620-3fa6-4ed8-becf-4adaa554a52d/console.log" append="off"/>
Aug 10 01:30:47 user nova-compute[73029]:     </serial>
Aug 10 01:30:47 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:30:47 user nova-compute[73029]:     <video>
Aug 10 01:30:47 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:30:47 user nova-compute[73029]:     </video>
Aug 10 01:30:47 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:30:47 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:30:47 user nova-compute[73029]:     </rng>
Aug 10 01:30:47 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:30:47 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:30:47 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:30:47 user nova-compute[73029]:     </memballoon>
Aug 10 01:30:47 user nova-compute[73029]:   </devices>
Aug 10 01:30:47 user nova-compute[73029]: </domain>
Aug 10 01:30:47 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T01:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-431804702',display_name='tempest-TestShelveInstance-server-431804702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-431804702',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-888846196',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d2819848c56e4be7a3ef09731134a75c',ramdisk_id='',reservation_id='r-sq5zk7b0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-353939251',owner_user_name='tempest-TestShelveInstance-353939251-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:30:36Z,user_data=None,user_id='ae1f274d3b714262bd06fde868b55aba',uuid=49412620-3fa6-4ed8-becf-4adaa554a52d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converting VIF {"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG os_vif [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0f035cd-ed, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0f035cd-ed, col_values=(('external_ids', {'iface-id': 'd0f035cd-ed95-410b-970a-3fc1c59ed421', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:6c:d2', 'vm-uuid': '49412620-3fa6-4ed8-becf-4adaa554a52d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:47 user nova-compute[73029]: INFO os_vif [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed')
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:30:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] No VIF found with MAC fa:16:3e:15:6c:d2, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:30:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-1dbc56fe-0e98-4ce8-a0f5-d9d0eb38a9ea req-8e1ef1e7-0b26-4fe5-aeda-ac8505f9aa20 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:30:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1dbc56fe-0e98-4ce8-a0f5-d9d0eb38a9ea req-8e1ef1e7-0b26-4fe5-aeda-ac8505f9aa20 service nova] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:30:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1dbc56fe-0e98-4ce8-a0f5-d9d0eb38a9ea req-8e1ef1e7-0b26-4fe5-aeda-ac8505f9aa20 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:30:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1dbc56fe-0e98-4ce8-a0f5-d9d0eb38a9ea req-8e1ef1e7-0b26-4fe5-aeda-ac8505f9aa20 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:30:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-1dbc56fe-0e98-4ce8-a0f5-d9d0eb38a9ea req-8e1ef1e7-0b26-4fe5-aeda-ac8505f9aa20 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] No waiting events found dispatching network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:30:48 user nova-compute[73029]: WARNING nova.compute.manager [req-1dbc56fe-0e98-4ce8-a0f5-d9d0eb38a9ea req-8e1ef1e7-0b26-4fe5-aeda-ac8505f9aa20 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received unexpected event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 10 01:30:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631050.590435, 49412620-3fa6-4ed8-becf-4adaa554a52d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:30:50 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] VM Resumed (Lifecycle Event)
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:30:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Instance spawned successfully.
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:30:50 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631050.5914505, 49412620-3fa6-4ed8-becf-4adaa554a52d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:30:50 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] VM Started (Lifecycle Event)
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-c1ee7fed-abfe-42dd-a109-037021ce15ed tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.316s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-c14f2c80-81d2-452a-9e5d-3bb9dbc15d1e req-f9ffbeb6-a17f-4c2e-ac86-5379d9010914 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c14f2c80-81d2-452a-9e5d-3bb9dbc15d1e req-f9ffbeb6-a17f-4c2e-ac86-5379d9010914 service nova] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c14f2c80-81d2-452a-9e5d-3bb9dbc15d1e req-f9ffbeb6-a17f-4c2e-ac86-5379d9010914 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c14f2c80-81d2-452a-9e5d-3bb9dbc15d1e req-f9ffbeb6-a17f-4c2e-ac86-5379d9010914 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:30:50 user nova-compute[73029]: DEBUG nova.compute.manager [req-c14f2c80-81d2-452a-9e5d-3bb9dbc15d1e req-f9ffbeb6-a17f-4c2e-ac86-5379d9010914 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] No waiting events found dispatching network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:30:50 user nova-compute[73029]: WARNING nova.compute.manager [req-c14f2c80-81d2-452a-9e5d-3bb9dbc15d1e req-f9ffbeb6-a17f-4c2e-ac86-5379d9010914 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received unexpected event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 for instance with vm_state active and task_state None.
Aug 10 01:30:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:30:56 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:30:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:06 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:31:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:31:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:31:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:31:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 49412620-3fa6-4ed8-becf-4adaa554a52d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:08 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:31:11 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:31:11 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8625MB free_disk=25.075733184814453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 164e6c98-8a6e-43b3-a5f7-b796a82126bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 49412620-3fa6-4ed8-becf-4adaa554a52d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:31:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:31:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-cc66554d-aace-4433-b60a-655b957cd315 req-9330450b-9883-4c55-9665-9087e5fd4992 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received event network-changed-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:31:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-cc66554d-aace-4433-b60a-655b957cd315 req-9330450b-9883-4c55-9665-9087e5fd4992 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Refreshing instance network info cache due to event network-changed-6b13c3a6-38a9-4943-87bb-1e9a2db38da7. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:31:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc66554d-aace-4433-b60a-655b957cd315 req-9330450b-9883-4c55-9665-9087e5fd4992 service nova] Acquiring lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:31:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc66554d-aace-4433-b60a-655b957cd315 req-9330450b-9883-4c55-9665-9087e5fd4992 service nova] Acquired lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:31:25 user nova-compute[73029]: DEBUG nova.network.neutron [req-cc66554d-aace-4433-b60a-655b957cd315 req-9330450b-9883-4c55-9665-9087e5fd4992 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Refreshing network info cache for port 6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:31:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-cc66554d-aace-4433-b60a-655b957cd315 req-9330450b-9883-4c55-9665-9087e5fd4992 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updated VIF entry in instance network info cache for port 6b13c3a6-38a9-4943-87bb-1e9a2db38da7. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:31:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-cc66554d-aace-4433-b60a-655b957cd315 req-9330450b-9883-4c55-9665-9087e5fd4992 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updating instance_info_cache with network_info: [{"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:31:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-cc66554d-aace-4433-b60a-655b957cd315 req-9330450b-9883-4c55-9665-9087e5fd4992 service nova] Releasing lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:31:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:31:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:31:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:31:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:31:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:31:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:31:35 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:31:35 user nova-compute[73029]: INFO nova.compute.claims [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Claim successful on node user
Aug 10 01:31:35 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:31:36 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:31:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:31:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:31:36 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:31:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:31:36 user nova-compute[73029]: DEBUG nova.network.neutron [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:31:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:31:36 user nova-compute[73029]: DEBUG nova.policy [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44698a7ae911479eb2d5d8a8103ac5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b217381b301d4650bc046a0031d044a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:31:36 user nova-compute[73029]: INFO nova.virt.block_device [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Booting with volume snapshot 670890b3-14ef-43dd-b5dc-79a360dfdff2 at /dev/vda
Aug 10 01:31:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Successfully created port: 820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:31:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Successfully updated port: 820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:31:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "refresh_cache-fb7dd3af-d0d3-4170-b2bb-144404dc54f1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:31:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquired lock "refresh_cache-fb7dd3af-d0d3-4170-b2bb-144404dc54f1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:31:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:31:37 user nova-compute[73029]: DEBUG nova.network.neutron [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:31:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-c8d844eb-a4d0-4650-a437-e0463a9a69fc req-c1f9c55e-1787-4262-b84b-8a372106e0ee service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-changed-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:31:37 user nova-compute[73029]: DEBUG nova.compute.manager [req-c8d844eb-a4d0-4650-a437-e0463a9a69fc req-c1f9c55e-1787-4262-b84b-8a372106e0ee service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Refreshing instance network info cache due to event network-changed-820c92b6-6f85-4ba7-8cb8-7008cf274984. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:31:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8d844eb-a4d0-4650-a437-e0463a9a69fc req-c1f9c55e-1787-4262-b84b-8a372106e0ee service nova] Acquiring lock "refresh_cache-fb7dd3af-d0d3-4170-b2bb-144404dc54f1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:31:38 user nova-compute[73029]: DEBUG nova.network.neutron [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Updating instance_info_cache with network_info: [{"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:31:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Releasing lock "refresh_cache-fb7dd3af-d0d3-4170-b2bb-144404dc54f1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:31:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Instance network_info: |[{"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:31:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8d844eb-a4d0-4650-a437-e0463a9a69fc req-c1f9c55e-1787-4262-b84b-8a372106e0ee service nova] Acquired lock "refresh_cache-fb7dd3af-d0d3-4170-b2bb-144404dc54f1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:31:38 user nova-compute[73029]: DEBUG nova.network.neutron [req-c8d844eb-a4d0-4650-a437-e0463a9a69fc req-c1f9c55e-1787-4262-b84b-8a372106e0ee service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Refreshing network info cache for port 820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:31:38 user nova-compute[73029]: DEBUG nova.network.neutron [req-c8d844eb-a4d0-4650-a437-e0463a9a69fc req-c1f9c55e-1787-4262-b84b-8a372106e0ee service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Updated VIF entry in instance network info cache for port 820c92b6-6f85-4ba7-8cb8-7008cf274984. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:31:38 user nova-compute[73029]: DEBUG nova.network.neutron [req-c8d844eb-a4d0-4650-a437-e0463a9a69fc req-c1f9c55e-1787-4262-b84b-8a372106e0ee service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Updating instance_info_cache with network_info: [{"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:31:38 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8d844eb-a4d0-4650-a437-e0463a9a69fc req-c1f9c55e-1787-4262-b84b-8a372106e0ee service nova] Releasing lock "refresh_cache-fb7dd3af-d0d3-4170-b2bb-144404dc54f1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG os_brick.utils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a074629d-2481-4408-9097-2e9b0b43df81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca97e25d-865d-4064-a022-abff844522ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bddc2e0-cdc0-4b18-8ff7-32fbcf9cfb1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb4b31a-af5d-4762-99d5-d5a07cf3d772]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:41 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:31:42 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:31:42 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3885e750-7a55-4988-95dc-b6485f210f3a]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG os_brick.utils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Updating existing volume attachment record: 8de5f0a5-258f-4f02-a9bc-37b8b7b349f5 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:31:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:31:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:31:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Creating image(s)
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Ensure instance console log exists: /opt/stack/data/nova/instances/fb7dd3af-d0d3-4170-b2bb-144404dc54f1/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Start _get_guest_xml network_info=[{"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-10T01:31:27Z,direct_url=<?>,disk_format='qcow2',id=5dfab465-40a6-4f6c-9e37-636007e4e0ea,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-798332261',owner='b217381b301d4650bc046a0031d044a7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-10T01:31:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '8de5f0a5-258f-4f02-a9bc-37b8b7b349f5', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GazInBmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb7dd3af-d0d3-4170-b2bb-144404dc54f1', 'attached_at': '', 'detached_at': '', 'volume_id': '1b77d6fe-5d4b-4f5c-a889-c8d534d43299', 'serial': '1b77d6fe-5d4b-4f5c-a889-c8d534d43299'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:31:50 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:31:50 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-10T01:31:27Z,direct_url=<?>,disk_format='qcow2',id=5dfab465-40a6-4f6c-9e37-636007e4e0ea,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-798332261',owner='b217381b301d4650bc046a0031d044a7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-10T01:31:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GazInBmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:31:50 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:31:50 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:31:50 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff36b47-914d-4cbf-8bf1-e92149ad2cb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:31:50 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b983d-1ea3-4009-ab79-46f8c53d391d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299] added
Aug 10 01:31:50 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[583417d1-a630-4e5c-9ba0-ac957e46fafc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f800fbb-0005-48e4-9608-f7705e6c7049]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GazInBmw {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GazInBmw" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f470df0-42bd-48e6-b67a-dd66de230eee]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GazInBmw'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbf9163-e33d-4dc3-a5fb-5794b99134d3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffd9298-8a40-47c7-a99c-6eb5603a853f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:31:50 user nova-compute[73029]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:31:50 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:31:50 user nova-compute[73029]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:31:50 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34c4a47-7da1-401d-8d02-03a00ffe9d47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299, portal: 172.16.0.220,3260]
Aug 10 01:31:50 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299, portal: 172.16.0.220,3260] successful.
Aug 10 01:31:50 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[98924be0-3c88-4371-a658-b187d3913a48]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab09243-6b92-4102-b65a-0a61ca3f38ee]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:31:50 user nova-compute[73029]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:31:50 user nova-compute[73029]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 (non-flash)
Aug 10 01:31:50 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:31:50 user nova-compute[73029]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:31:50 user nova-compute[73029]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 (non-flash)
Aug 10 01:31:50 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e12d39-c939-4c6f-81f7-61ad5852048e]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:31:50 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GazInBmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23139623164646538', 'path': '/dev/sdd'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139623164646538', 'path': '/dev/sdd'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1533495584',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1533495584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1533495584',id=46,image_ref='5dfab465-40a6-4f6c-9e37-636007e4e0ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2ZN2H6WlMz5vR4o4uom6WZ5K/Ujgi3aKmFwPxbiu7TsFTf8jZBYzYbgCy5oQTxD3UnF5h1kXX6OhCGWjCNLD7sAo5Wh+zYe+qNcbYhFulHBgcL9jTkEH3TX8ounYFRmg==',key_name='tempest-keypair-1790061763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-a80urn9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1870123799',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:31:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=fb7dd3af-d0d3-4170-b2bb-144404dc54f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:49,bridge_name='br-int',has_traffic_filtering=True,id=820c92b6-6f85-4ba7-8cb8-7008cf274984,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820c92b6-6f') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG nova.objects.instance [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'pci_devices' on Instance uuid fb7dd3af-d0d3-4170-b2bb-144404dc54f1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:31:51 user nova-compute[73029]:   <uuid>fb7dd3af-d0d3-4170-b2bb-144404dc54f1</uuid>
Aug 10 01:31:51 user nova-compute[73029]:   <name>instance-0000002e</name>
Aug 10 01:31:51 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:31:51 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:31:51 user nova-compute[73029]:   <metadata>
Aug 10 01:31:51 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:31:51 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:31:51 user nova-compute[73029]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1533495584</nova:name>
Aug 10 01:31:51 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:31:50</nova:creationTime>
Aug 10 01:31:51 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:31:51 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:31:51 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:31:51 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:31:51 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:31:51 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:31:51 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:31:51 user nova-compute[73029]:       <nova:owner>
Aug 10 01:31:51 user nova-compute[73029]:         <nova:user uuid="44698a7ae911479eb2d5d8a8103ac5dd">tempest-TestVolumeBootPattern-1870123799-project-member</nova:user>
Aug 10 01:31:51 user nova-compute[73029]:         <nova:project uuid="b217381b301d4650bc046a0031d044a7">tempest-TestVolumeBootPattern-1870123799</nova:project>
Aug 10 01:31:51 user nova-compute[73029]:       </nova:owner>
Aug 10 01:31:51 user nova-compute[73029]:       <nova:root type="image" uuid="5dfab465-40a6-4f6c-9e37-636007e4e0ea"/>
Aug 10 01:31:51 user nova-compute[73029]:       <nova:ports>
Aug 10 01:31:51 user nova-compute[73029]:         <nova:port uuid="820c92b6-6f85-4ba7-8cb8-7008cf274984">
Aug 10 01:31:51 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 10 01:31:51 user nova-compute[73029]:         </nova:port>
Aug 10 01:31:51 user nova-compute[73029]:       </nova:ports>
Aug 10 01:31:51 user nova-compute[73029]:     </nova:instance>
Aug 10 01:31:51 user nova-compute[73029]:   </metadata>
Aug 10 01:31:51 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:31:51 user nova-compute[73029]:     <system>
Aug 10 01:31:51 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:31:51 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:31:51 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:31:51 user nova-compute[73029]:       <entry name="serial">fb7dd3af-d0d3-4170-b2bb-144404dc54f1</entry>
Aug 10 01:31:51 user nova-compute[73029]:       <entry name="uuid">fb7dd3af-d0d3-4170-b2bb-144404dc54f1</entry>
Aug 10 01:31:51 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:31:51 user nova-compute[73029]:     </system>
Aug 10 01:31:51 user nova-compute[73029]:   </sysinfo>
Aug 10 01:31:51 user nova-compute[73029]:   <os>
Aug 10 01:31:51 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:31:51 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:31:51 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:31:51 user nova-compute[73029]:   </os>
Aug 10 01:31:51 user nova-compute[73029]:   <features>
Aug 10 01:31:51 user nova-compute[73029]:     <acpi/>
Aug 10 01:31:51 user nova-compute[73029]:     <apic/>
Aug 10 01:31:51 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:31:51 user nova-compute[73029]:   </features>
Aug 10 01:31:51 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:31:51 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:31:51 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:31:51 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:31:51 user nova-compute[73029]:   </clock>
Aug 10 01:31:51 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:31:51 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:31:51 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:31:51 user nova-compute[73029]:   </cpu>
Aug 10 01:31:51 user nova-compute[73029]:   <devices>
Aug 10 01:31:51 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:31:51 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:31:51 user nova-compute[73029]:       <source dev="/dev/sdd"/>
Aug 10 01:31:51 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:31:51 user nova-compute[73029]:       <serial>1b77d6fe-5d4b-4f5c-a889-c8d534d43299</serial>
Aug 10 01:31:51 user nova-compute[73029]:     </disk>
Aug 10 01:31:51 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:31:51 user nova-compute[73029]:       <mac address="fa:16:3e:b5:84:49"/>
Aug 10 01:31:51 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:31:51 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:31:51 user nova-compute[73029]:       <target dev="tap820c92b6-6f"/>
Aug 10 01:31:51 user nova-compute[73029]:     </interface>
Aug 10 01:31:51 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:31:51 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/fb7dd3af-d0d3-4170-b2bb-144404dc54f1/console.log" append="off"/>
Aug 10 01:31:51 user nova-compute[73029]:     </serial>
Aug 10 01:31:51 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:31:51 user nova-compute[73029]:     <video>
Aug 10 01:31:51 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:31:51 user nova-compute[73029]:     </video>
Aug 10 01:31:51 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:31:51 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:31:51 user nova-compute[73029]:     </rng>
Aug 10 01:31:51 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:31:51 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:31:51 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:31:51 user nova-compute[73029]:     </memballoon>
Aug 10 01:31:51 user nova-compute[73029]:   </devices>
Aug 10 01:31:51 user nova-compute[73029]: </domain>
Aug 10 01:31:51 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1533495584',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1533495584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1533495584',id=46,image_ref='5dfab465-40a6-4f6c-9e37-636007e4e0ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2ZN2H6WlMz5vR4o4uom6WZ5K/Ujgi3aKmFwPxbiu7TsFTf8jZBYzYbgCy5oQTxD3UnF5h1kXX6OhCGWjCNLD7sAo5Wh+zYe+qNcbYhFulHBgcL9jTkEH3TX8ounYFRmg==',key_name='tempest-keypair-1790061763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-a80urn9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1870123799',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:31:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=fb7dd3af-d0d3-4170-b2bb-144404dc54f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:49,bridge_name='br-int',has_traffic_filtering=True,id=820c92b6-6f85-4ba7-8cb8-7008cf274984,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820c92b6-6f') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG os_vif [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:49,bridge_name='br-int',has_traffic_filtering=True,id=820c92b6-6f85-4ba7-8cb8-7008cf274984,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820c92b6-6f') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap820c92b6-6f, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap820c92b6-6f, col_values=(('external_ids', {'iface-id': '820c92b6-6f85-4ba7-8cb8-7008cf274984', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:84:49', 'vm-uuid': 'fb7dd3af-d0d3-4170-b2bb-144404dc54f1'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:31:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:51 user nova-compute[73029]: INFO os_vif [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:49,bridge_name='br-int',has_traffic_filtering=True,id=820c92b6-6f85-4ba7-8cb8-7008cf274984,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820c92b6-6f')
Aug 10 01:31:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:31:52 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No VIF found with MAC fa:16:3e:b5:84:49, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-fea33af7-5f9c-4338-832a-3e747bc205d0 req-98533008-7fd6-4e9d-ab7c-7de29d48fe6a service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fea33af7-5f9c-4338-832a-3e747bc205d0 req-98533008-7fd6-4e9d-ab7c-7de29d48fe6a service nova] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fea33af7-5f9c-4338-832a-3e747bc205d0 req-98533008-7fd6-4e9d-ab7c-7de29d48fe6a service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fea33af7-5f9c-4338-832a-3e747bc205d0 req-98533008-7fd6-4e9d-ab7c-7de29d48fe6a service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:31:53 user nova-compute[73029]: DEBUG nova.compute.manager [req-fea33af7-5f9c-4338-832a-3e747bc205d0 req-98533008-7fd6-4e9d-ab7c-7de29d48fe6a service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] No waiting events found dispatching network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:31:53 user nova-compute[73029]: WARNING nova.compute.manager [req-fea33af7-5f9c-4338-832a-3e747bc205d0 req-98533008-7fd6-4e9d-ab7c-7de29d48fe6a service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received unexpected event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 for instance with vm_state building and task_state spawning.
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631115.2935507, fb7dd3af-d0d3-4170-b2bb-144404dc54f1 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:31:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] VM Resumed (Lifecycle Event)
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:31:55 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Instance spawned successfully.
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:31:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631115.2950685, fb7dd3af-d0d3-4170-b2bb-144404dc54f1 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:31:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] VM Started (Lifecycle Event)
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:31:55 user nova-compute[73029]: INFO nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:31:55 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:31:55 user nova-compute[73029]: INFO nova.compute.manager [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Took 19.68 seconds to build instance.
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-0978f4b9-249d-445a-b1b3-8ab6811a4326 req-88cf6a64-f761-44e0-891f-d820800a0f90 service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0978f4b9-249d-445a-b1b3-8ab6811a4326 req-88cf6a64-f761-44e0-891f-d820800a0f90 service nova] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0978f4b9-249d-445a-b1b3-8ab6811a4326 req-88cf6a64-f761-44e0-891f-d820800a0f90 service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0978f4b9-249d-445a-b1b3-8ab6811a4326 req-88cf6a64-f761-44e0-891f-d820800a0f90 service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:31:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-0978f4b9-249d-445a-b1b3-8ab6811a4326 req-88cf6a64-f761-44e0-891f-d820800a0f90 service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] No waiting events found dispatching network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:31:55 user nova-compute[73029]: WARNING nova.compute.manager [req-0978f4b9-249d-445a-b1b3-8ab6811a4326 req-88cf6a64-f761-44e0-891f-d820800a0f90 service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received unexpected event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 for instance with vm_state active and task_state None.
Aug 10 01:31:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-82a41202-6ebb-4bb2-bfe0-eefab4cf42f2 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.770s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:31:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:31:57 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:31:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:04 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:09 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:32:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:32:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:32:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:32:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:32:10 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updating instance_info_cache with network_info: [{"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:32:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:32:10 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:32:11 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:32:11 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=25.06584930419922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 164e6c98-8a6e-43b3-a5f7-b796a82126bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 49412620-3fa6-4ed8-becf-4adaa554a52d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance fb7dd3af-d0d3-4170-b2bb-144404dc54f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:32:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:32:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:32:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-db9b8669-6fea-4942-a2e2-8c681ab29c65 req-3e1475c0-41d2-41e9-8840-892a194715de service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-db9b8669-6fea-4942-a2e2-8c681ab29c65 req-3e1475c0-41d2-41e9-8840-892a194715de service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing instance network info cache due to event network-changed-d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-db9b8669-6fea-4942-a2e2-8c681ab29c65 req-3e1475c0-41d2-41e9-8840-892a194715de service nova] Acquiring lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-db9b8669-6fea-4942-a2e2-8c681ab29c65 req-3e1475c0-41d2-41e9-8840-892a194715de service nova] Acquired lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-db9b8669-6fea-4942-a2e2-8c681ab29c65 req-3e1475c0-41d2-41e9-8840-892a194715de service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Refreshing network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:32:26 user nova-compute[73029]: INFO nova.compute.manager [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Terminating instance
Aug 10 01:32:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-5dc237af-1f8d-449a-ad6d-63733ef4cb5a req-22c11d0f-7dc0-43c4-a288-6eda39e44796 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-unplugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5dc237af-1f8d-449a-ad6d-63733ef4cb5a req-22c11d0f-7dc0-43c4-a288-6eda39e44796 service nova] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5dc237af-1f8d-449a-ad6d-63733ef4cb5a req-22c11d0f-7dc0-43c4-a288-6eda39e44796 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-5dc237af-1f8d-449a-ad6d-63733ef4cb5a req-22c11d0f-7dc0-43c4-a288-6eda39e44796 service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-5dc237af-1f8d-449a-ad6d-63733ef4cb5a req-22c11d0f-7dc0-43c4-a288-6eda39e44796 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] No waiting events found dispatching network-vif-unplugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-5dc237af-1f8d-449a-ad6d-63733ef4cb5a req-22c11d0f-7dc0-43c4-a288-6eda39e44796 service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-unplugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-db9b8669-6fea-4942-a2e2-8c681ab29c65 req-3e1475c0-41d2-41e9-8840-892a194715de service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updated VIF entry in instance network info cache for port d0f035cd-ed95-410b-970a-3fc1c59ed421. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-db9b8669-6fea-4942-a2e2-8c681ab29c65 req-3e1475c0-41d2-41e9-8840-892a194715de service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [{"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:32:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-db9b8669-6fea-4942-a2e2-8c681ab29c65 req-3e1475c0-41d2-41e9-8840-892a194715de service nova] Releasing lock "refresh_cache-49412620-3fa6-4ed8-becf-4adaa554a52d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Instance destroyed successfully.
Aug 10 01:32:27 user nova-compute[73029]: DEBUG nova.objects.instance [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lazy-loading 'resources' on Instance uuid 49412620-3fa6-4ed8-becf-4adaa554a52d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-10T01:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-431804702',display_name='tempest-TestShelveInstance-server-431804702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-431804702',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV8vLVb8lS4XmOQNCAPTyWEXaT+dXAV2KyTR3VoGPMFC9ZsEDz0ZEBVVBknGOssGkhH+J4KgCPVCcfe1Ex8sNeU4PknHYOyUr7AtjaoMHOIeTeB/nqX1v7emjQRXmrz8w==',key_name='tempest-TestShelveInstance-888846196',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:30:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2819848c56e4be7a3ef09731134a75c',ramdisk_id='',reservation_id='r-sq5zk7b0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-353939251',owner_user_name='tempest-TestShelveInstance-353939251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:30:51Z,user_data=None,user_id='ae1f274d3b714262bd06fde868b55aba',uuid=49412620-3fa6-4ed8-becf-4adaa554a52d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converting VIF {"id": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "address": "fa:16:3e:15:6c:d2", "network": {"id": "9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c", "bridge": "br-int", "label": "tempest-TestShelveInstance-303524844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2819848c56e4be7a3ef09731134a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0f035cd-ed", "ovs_interfaceid": "d0f035cd-ed95-410b-970a-3fc1c59ed421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_vif [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0f035cd-ed, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:32:27 user nova-compute[73029]: INFO os_vif [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:6c:d2,bridge_name='br-int',has_traffic_filtering=True,id=d0f035cd-ed95-410b-970a-3fc1c59ed421,network=Network(9c8855a2-2e96-4fc0-8b6b-1fbacd9a719c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0f035cd-ed')
Aug 10 01:32:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcRITWaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:32:27 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[31924532-adc7-4523-be02-f004af3f61b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[427ec49a-ebe8-48ff-bca9-4efc67b0a95d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:32:27 user nova-compute[73029]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:32:27 user nova-compute[73029]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 (non-flash)
Aug 10 01:32:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:32:27 user nova-compute[73029]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a (non-flash)
Aug 10 01:32:27 user nova-compute[73029]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 (non-flash)
Aug 10 01:32:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f06b2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec42707-d282-415c-83fc-219ea0f26cda]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56ad13b-4921-4f03-a20d-8a26d8f53670]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9507099f-d291-42ca-abe2-8c5a8a045364]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2d80b8-72bb-42ee-b5a8-fbf6c05b3330]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23438343465373763', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_feacc90a', '/dev/disk/by-id/scsi-1SCST_BIOfeacc90a-4844e77cdcc9c468') {{(pid=84041) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[114f9b4c-1bdb-4275-8123-8bac472dcc66]: (4, None) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ce082-6422-4cdd-bd00-8e300fa6a365]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbc725b-6f93-4502-8bfa-fd01dad7f377]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260]
Aug 10 01:32:27 user nova-compute[73029]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a, portal: 172.16.0.220,3260] successful.
Aug 10 01:32:27 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:870df3e1-71ee-4d96-b3f2-b62a42a69e8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f106b68-8857-4be7-afd8-d81c6247298d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] <== disconnect_volume: return (273ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:32:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Deleting instance files /opt/stack/data/nova/instances/49412620-3fa6-4ed8-becf-4adaa554a52d_del
Aug 10 01:32:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Deletion of /opt/stack/data/nova/instances/49412620-3fa6-4ed8-becf-4adaa554a52d_del complete
Aug 10 01:32:27 user nova-compute[73029]: INFO nova.compute.manager [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 10 01:32:27 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:32:27 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:32:28 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:32:28 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Took 0.55 seconds to deallocate network for instance.
Aug 10 01:32:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ab3fa662-251a-4c6a-a068-c0e9e88badca req-4239cac2-300b-403d-a870-fd01b9d7eade service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-deleted-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:32:28 user nova-compute[73029]: INFO nova.compute.manager [req-ab3fa662-251a-4c6a-a068-c0e9e88badca req-4239cac2-300b-403d-a870-fd01b9d7eade service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Neutron deleted interface d0f035cd-ed95-410b-970a-3fc1c59ed421; detaching it from the instance and deleting it from the info cache
Aug 10 01:32:28 user nova-compute[73029]: DEBUG nova.network.neutron [req-ab3fa662-251a-4c6a-a068-c0e9e88badca req-4239cac2-300b-403d-a870-fd01b9d7eade service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:32:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-ab3fa662-251a-4c6a-a068-c0e9e88badca req-4239cac2-300b-403d-a870-fd01b9d7eade service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Detach interface failed, port_id=d0f035cd-ed95-410b-970a-3fc1c59ed421, reason: Instance 49412620-3fa6-4ed8-becf-4adaa554a52d could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 01:32:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-e9958ec6-eb7d-4482-a5bf-99d5dd78311e req-9d85c786-d413-4a04-a06c-af4cc9b94a8b service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:32:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e9958ec6-eb7d-4482-a5bf-99d5dd78311e req-9d85c786-d413-4a04-a06c-af4cc9b94a8b service nova] Acquiring lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:32:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e9958ec6-eb7d-4482-a5bf-99d5dd78311e req-9d85c786-d413-4a04-a06c-af4cc9b94a8b service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:32:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e9958ec6-eb7d-4482-a5bf-99d5dd78311e req-9d85c786-d413-4a04-a06c-af4cc9b94a8b service nova] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:32:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-e9958ec6-eb7d-4482-a5bf-99d5dd78311e req-9d85c786-d413-4a04-a06c-af4cc9b94a8b service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] No waiting events found dispatching network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:32:28 user nova-compute[73029]: WARNING nova.compute.manager [req-e9958ec6-eb7d-4482-a5bf-99d5dd78311e req-9d85c786-d413-4a04-a06c-af4cc9b94a8b service nova] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Received unexpected event network-vif-plugged-d0f035cd-ed95-410b-970a-3fc1c59ed421 for instance with vm_state active and task_state deleting.
Aug 10 01:32:29 user nova-compute[73029]: INFO nova.compute.manager [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Took 0.75 seconds to detach 1 volumes for instance.
Aug 10 01:32:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Deleting volume: 870df3e1-71ee-4d96-b3f2-b62a42a69e8a {{(pid=73029) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 10 01:32:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:32:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:32:29 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:32:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:32:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:32:29 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Deleted allocations for instance 49412620-3fa6-4ed8-becf-4adaa554a52d
Aug 10 01:32:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3b423e8d-8715-47bc-9c27-b5c887e87025 tempest-TestShelveInstance-353939251 tempest-TestShelveInstance-353939251-project-member] Lock "49412620-3fa6-4ed8-becf-4adaa554a52d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.005s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:32:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:32:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:32:42 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691631147.3228667, 49412620-3fa6-4ed8-becf-4adaa554a52d => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:32:42 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] VM Stopped (Lifecycle Event)
Aug 10 01:32:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-98bd105c-48da-41a3-93ff-59d319e79130 None None] [instance: 49412620-3fa6-4ed8-becf-4adaa554a52d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:32:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:32:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:32:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:32:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:32:58 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:33:05 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:33:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid 164e6c98-8a6e-43b3-a5f7-b796a82126bb {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updating instance_info_cache with network_info: [{"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-164e6c98-8a6e-43b3-a5f7-b796a82126bb" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:12 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:33:12 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=25.064918518066406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 164e6c98-8a6e-43b3-a5f7-b796a82126bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance fb7dd3af-d0d3-4170-b2bb-144404dc54f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:33:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-241b8d52-c2d4-471f-9d51-f18d4f2ab81a req-35d5d7db-51a5-4b9b-983c-b2e8db8b923d service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-changed-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-241b8d52-c2d4-471f-9d51-f18d4f2ab81a req-35d5d7db-51a5-4b9b-983c-b2e8db8b923d service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Refreshing instance network info cache due to event network-changed-820c92b6-6f85-4ba7-8cb8-7008cf274984. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:33:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-241b8d52-c2d4-471f-9d51-f18d4f2ab81a req-35d5d7db-51a5-4b9b-983c-b2e8db8b923d service nova] Acquiring lock "refresh_cache-fb7dd3af-d0d3-4170-b2bb-144404dc54f1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:33:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-241b8d52-c2d4-471f-9d51-f18d4f2ab81a req-35d5d7db-51a5-4b9b-983c-b2e8db8b923d service nova] Acquired lock "refresh_cache-fb7dd3af-d0d3-4170-b2bb-144404dc54f1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:33:26 user nova-compute[73029]: DEBUG nova.network.neutron [req-241b8d52-c2d4-471f-9d51-f18d4f2ab81a req-35d5d7db-51a5-4b9b-983c-b2e8db8b923d service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Refreshing network info cache for port 820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:33:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:28 user nova-compute[73029]: INFO nova.compute.manager [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Terminating instance
Aug 10 01:33:28 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG nova.network.neutron [req-241b8d52-c2d4-471f-9d51-f18d4f2ab81a req-35d5d7db-51a5-4b9b-983c-b2e8db8b923d service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Updated VIF entry in instance network info cache for port 820c92b6-6f85-4ba7-8cb8-7008cf274984. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG nova.network.neutron [req-241b8d52-c2d4-471f-9d51-f18d4f2ab81a req-35d5d7db-51a5-4b9b-983c-b2e8db8b923d service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Updating instance_info_cache with network_info: [{"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-241b8d52-c2d4-471f-9d51-f18d4f2ab81a req-35d5d7db-51a5-4b9b-983c-b2e8db8b923d service nova] Releasing lock "refresh_cache-fb7dd3af-d0d3-4170-b2bb-144404dc54f1" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-b954129f-d657-498e-8953-718669403892 req-702f9b25-48ca-425c-bfb1-efd0fa2f20c2 service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-unplugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b954129f-d657-498e-8953-718669403892 req-702f9b25-48ca-425c-bfb1-efd0fa2f20c2 service nova] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b954129f-d657-498e-8953-718669403892 req-702f9b25-48ca-425c-bfb1-efd0fa2f20c2 service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b954129f-d657-498e-8953-718669403892 req-702f9b25-48ca-425c-bfb1-efd0fa2f20c2 service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-b954129f-d657-498e-8953-718669403892 req-702f9b25-48ca-425c-bfb1-efd0fa2f20c2 service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] No waiting events found dispatching network-vif-unplugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-b954129f-d657-498e-8953-718669403892 req-702f9b25-48ca-425c-bfb1-efd0fa2f20c2 service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-unplugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Instance destroyed successfully.
Aug 10 01:33:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'resources' on Instance uuid fb7dd3af-d0d3-4170-b2bb-144404dc54f1 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1533495584',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1533495584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1533495584',id=46,image_ref='5dfab465-40a6-4f6c-9e37-636007e4e0ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2ZN2H6WlMz5vR4o4uom6WZ5K/Ujgi3aKmFwPxbiu7TsFTf8jZBYzYbgCy5oQTxD3UnF5h1kXX6OhCGWjCNLD7sAo5Wh+zYe+qNcbYhFulHBgcL9jTkEH3TX8ounYFRmg==',key_name='tempest-keypair-1790061763',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-a80urn9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1870123799',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:31:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=fb7dd3af-d0d3-4170-b2bb-144404dc54f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "address": "fa:16:3e:b5:84:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820c92b6-6f", "ovs_interfaceid": "820c92b6-6f85-4ba7-8cb8-7008cf274984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:49,bridge_name='br-int',has_traffic_filtering=True,id=820c92b6-6f85-4ba7-8cb8-7008cf274984,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820c92b6-6f') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_vif [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:49,bridge_name='br-int',has_traffic_filtering=True,id=820c92b6-6f85-4ba7-8cb8-7008cf274984,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820c92b6-6f') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap820c92b6-6f, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:33:29 user nova-compute[73029]: INFO os_vif [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:49,bridge_name='br-int',has_traffic_filtering=True,id=820c92b6-6f85-4ba7-8cb8-7008cf274984,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820c92b6-6f')
Aug 10 01:33:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GazInBmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:33:29 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ea294f-e3dc-42c5-9ef4-05f425309eca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[199e6ed4-e355-460c-9c5c-fe761b7d0a97]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:33:29 user nova-compute[73029]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 (non-flash)
Aug 10 01:33:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:33:29 user nova-compute[73029]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 (non-flash)
Aug 10 01:33:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f070cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299'): ({'sdd'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Removing single pathed devices sdd {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8840ee59-22c2-4120-9996-889f38cebb19]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef5d783-c062-49ff-bf2f-9e4c3d58437a]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flushing IO for device /dev/sdd {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3decd3d-98c0-46ce-a18e-e8809e95eb60]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdd8bd7-81bd-4d15-9a40-b31d04925838]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] SCSI volumes sdd have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8c52fd-4d25-427a-9e96-e1b8636176ba]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b2baa-ec18-4d77-9492-783c3779be01]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299, portal: 172.16.0.220,3260]
Aug 10 01:33:29 user nova-compute[73029]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299, portal: 172.16.0.220,3260] successful.
Aug 10 01:33:29 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b77d6fe-5d4b-4f5c-a889-c8d534d43299 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7165d1bd-7c1b-4bbd-8b38-5ec70d71da25]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== disconnect_volume: return (302ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:33:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Deleting instance files /opt/stack/data/nova/instances/fb7dd3af-d0d3-4170-b2bb-144404dc54f1_del
Aug 10 01:33:29 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Deletion of /opt/stack/data/nova/instances/fb7dd3af-d0d3-4170-b2bb-144404dc54f1_del complete
Aug 10 01:33:29 user nova-compute[73029]: INFO nova.compute.manager [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 10 01:33:29 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:33:30 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Took 0.95 seconds to deallocate network for instance.
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-ad3d2da4-f20b-45b8-9035-904eab5dd572 req-ad1cc04b-7433-4308-b68a-4ebccb72e184 service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-deleted-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] No waiting events found dispatching network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:33:30 user nova-compute[73029]: WARNING nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received unexpected event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 for instance with vm_state active and task_state deleting.
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] No waiting events found dispatching network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:33:30 user nova-compute[73029]: WARNING nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received unexpected event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 for instance with vm_state active and task_state deleting.
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] No waiting events found dispatching network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:33:30 user nova-compute[73029]: WARNING nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received unexpected event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 for instance with vm_state active and task_state deleting.
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-unplugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] No waiting events found dispatching network-vif-unplugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-unplugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Acquiring lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] No waiting events found dispatching network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:33:30 user nova-compute[73029]: WARNING nova.compute.manager [req-32819592-7351-4802-9891-e22ed2b48c0e req-59252371-624c-4c28-beb5-3d842211a77f service nova] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Received unexpected event network-vif-plugged-820c92b6-6f85-4ba7-8cb8-7008cf274984 for instance with vm_state active and task_state deleting.
Aug 10 01:33:31 user nova-compute[73029]: INFO nova.compute.manager [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Took 0.75 seconds to detach 1 volumes for instance.
Aug 10 01:33:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Deleting volume: 1b77d6fe-5d4b-4f5c-a889-c8d534d43299 {{(pid=73029) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 10 01:33:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:31 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:33:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:33:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:31 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Deleted allocations for instance fb7dd3af-d0d3-4170-b2bb-144404dc54f1
Aug 10 01:33:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e0862b9d-210e-4e50-ac43-5305e7244e11 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "fb7dd3af-d0d3-4170-b2bb-144404dc54f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.349s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:33:42 user nova-compute[73029]: INFO nova.compute.claims [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Claim successful on node user
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:42 user nova-compute[73029]: WARNING nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid 164e6c98-8a6e-43b3-a5f7-b796a82126bb {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Triggering sync for uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:33:42 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.policy [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78c0f17ce2de4d6e9157b86db5d1a59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9215a23c39a8459189ebc450d8e8c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:33:42 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Creating image(s)
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "/opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "/opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk 1073741824" returned: 0 in 0.055s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:42 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Cannot resize image /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'migration_context' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Ensure instance console log exists: /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Successfully created port: de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:33:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691631209.044914, fb7dd3af-d0d3-4170-b2bb-144404dc54f1 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:33:44 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] VM Stopped (Lifecycle Event)
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-a2ab6f33-70be-4a60-b8f1-23bf8b315db1 None None] [instance: fb7dd3af-d0d3-4170-b2bb-144404dc54f1] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Successfully updated port: de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquired lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-02d647b6-91a3-4c9d-b007-5a8b67095a67 req-49897596-5a3d-48e5-afae-d59abc7a9826 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received event network-changed-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.compute.manager [req-02d647b6-91a3-4c9d-b007-5a8b67095a67 req-49897596-5a3d-48e5-afae-d59abc7a9826 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Refreshing instance network info cache due to event network-changed-de6c581c-f84d-4519-9cd7-7f81b40870dc. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-02d647b6-91a3-4c9d-b007-5a8b67095a67 req-49897596-5a3d-48e5-afae-d59abc7a9826 service nova] Acquiring lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.neutron [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating instance_info_cache with network_info: [{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Releasing lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Instance network_info: |[{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-02d647b6-91a3-4c9d-b007-5a8b67095a67 req-49897596-5a3d-48e5-afae-d59abc7a9826 service nova] Acquired lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.neutron [req-02d647b6-91a3-4c9d-b007-5a8b67095a67 req-49897596-5a3d-48e5-afae-d59abc7a9826 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Refreshing network info cache for port de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Start _get_guest_xml network_info=[{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:33:44 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:33:44 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-212852808',display_name='tempest-TestStampPattern-server-212852808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-212852808',id=47,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAddBkpSKohxYOXkI3rImgDqSstvP3ZRXcIf/qUsLQoP0yH4xe/0HVF+nDjSxI3MoMcBmnNa4AjB+RjR3Qrtfpqu5nAJJmTCSg0WHfY3z/SYwdN1kQs2MBTqdEgrMr0vg==',key_name='tempest-TestStampPattern-2134481350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9215a23c39a8459189ebc450d8e8c04a',ramdisk_id='',reservation_id='r-ihta25sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-174573223',owner_user_name='tempest-TestStampPattern-174573223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:33:42Z,user_data=None,user_id='78c0f17ce2de4d6e9157b86db5d1a59e',uuid=a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converting VIF {"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:db,bridge_name='br-int',has_traffic_filtering=True,id=de6c581c-f84d-4519-9cd7-7f81b40870dc,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde6c581c-f8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.objects.instance [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'pci_devices' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:33:44 user nova-compute[73029]:   <uuid>a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7</uuid>
Aug 10 01:33:44 user nova-compute[73029]:   <name>instance-0000002f</name>
Aug 10 01:33:44 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:33:44 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:33:44 user nova-compute[73029]:   <metadata>
Aug 10 01:33:44 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:33:44 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:33:44 user nova-compute[73029]:       <nova:name>tempest-TestStampPattern-server-212852808</nova:name>
Aug 10 01:33:44 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:33:44</nova:creationTime>
Aug 10 01:33:44 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:33:44 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:33:44 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:33:44 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:33:44 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:33:44 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:33:44 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:33:44 user nova-compute[73029]:       <nova:owner>
Aug 10 01:33:44 user nova-compute[73029]:         <nova:user uuid="78c0f17ce2de4d6e9157b86db5d1a59e">tempest-TestStampPattern-174573223-project-member</nova:user>
Aug 10 01:33:44 user nova-compute[73029]:         <nova:project uuid="9215a23c39a8459189ebc450d8e8c04a">tempest-TestStampPattern-174573223</nova:project>
Aug 10 01:33:44 user nova-compute[73029]:       </nova:owner>
Aug 10 01:33:44 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:33:44 user nova-compute[73029]:       <nova:ports>
Aug 10 01:33:44 user nova-compute[73029]:         <nova:port uuid="de6c581c-f84d-4519-9cd7-7f81b40870dc">
Aug 10 01:33:44 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 01:33:44 user nova-compute[73029]:         </nova:port>
Aug 10 01:33:44 user nova-compute[73029]:       </nova:ports>
Aug 10 01:33:44 user nova-compute[73029]:     </nova:instance>
Aug 10 01:33:44 user nova-compute[73029]:   </metadata>
Aug 10 01:33:44 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:33:44 user nova-compute[73029]:     <system>
Aug 10 01:33:44 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:33:44 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:33:44 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:33:44 user nova-compute[73029]:       <entry name="serial">a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7</entry>
Aug 10 01:33:44 user nova-compute[73029]:       <entry name="uuid">a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7</entry>
Aug 10 01:33:44 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:33:44 user nova-compute[73029]:     </system>
Aug 10 01:33:44 user nova-compute[73029]:   </sysinfo>
Aug 10 01:33:44 user nova-compute[73029]:   <os>
Aug 10 01:33:44 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:33:44 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:33:44 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:33:44 user nova-compute[73029]:   </os>
Aug 10 01:33:44 user nova-compute[73029]:   <features>
Aug 10 01:33:44 user nova-compute[73029]:     <acpi/>
Aug 10 01:33:44 user nova-compute[73029]:     <apic/>
Aug 10 01:33:44 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:33:44 user nova-compute[73029]:   </features>
Aug 10 01:33:44 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:33:44 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:33:44 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:33:44 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:33:44 user nova-compute[73029]:   </clock>
Aug 10 01:33:44 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:33:44 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:33:44 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:33:44 user nova-compute[73029]:   </cpu>
Aug 10 01:33:44 user nova-compute[73029]:   <devices>
Aug 10 01:33:44 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:33:44 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:33:44 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk"/>
Aug 10 01:33:44 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:33:44 user nova-compute[73029]:     </disk>
Aug 10 01:33:44 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:33:44 user nova-compute[73029]:       <mac address="fa:16:3e:86:d6:db"/>
Aug 10 01:33:44 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:33:44 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:33:44 user nova-compute[73029]:       <target dev="tapde6c581c-f8"/>
Aug 10 01:33:44 user nova-compute[73029]:     </interface>
Aug 10 01:33:44 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:33:44 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/console.log" append="off"/>
Aug 10 01:33:44 user nova-compute[73029]:     </serial>
Aug 10 01:33:44 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:33:44 user nova-compute[73029]:     <video>
Aug 10 01:33:44 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:33:44 user nova-compute[73029]:     </video>
Aug 10 01:33:44 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:33:44 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:33:44 user nova-compute[73029]:     </rng>
Aug 10 01:33:44 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:33:44 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:33:44 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:33:44 user nova-compute[73029]:     </memballoon>
Aug 10 01:33:44 user nova-compute[73029]:   </devices>
Aug 10 01:33:44 user nova-compute[73029]: </domain>
Aug 10 01:33:44 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-212852808',display_name='tempest-TestStampPattern-server-212852808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-212852808',id=47,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAddBkpSKohxYOXkI3rImgDqSstvP3ZRXcIf/qUsLQoP0yH4xe/0HVF+nDjSxI3MoMcBmnNa4AjB+RjR3Qrtfpqu5nAJJmTCSg0WHfY3z/SYwdN1kQs2MBTqdEgrMr0vg==',key_name='tempest-TestStampPattern-2134481350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9215a23c39a8459189ebc450d8e8c04a',ramdisk_id='',reservation_id='r-ihta25sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-174573223',owner_user_name='tempest-TestStampPattern-174573223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:33:42Z,user_data=None,user_id='78c0f17ce2de4d6e9157b86db5d1a59e',uuid=a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converting VIF {"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:db,bridge_name='br-int',has_traffic_filtering=True,id=de6c581c-f84d-4519-9cd7-7f81b40870dc,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde6c581c-f8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG os_vif [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:db,bridge_name='br-int',has_traffic_filtering=True,id=de6c581c-f84d-4519-9cd7-7f81b40870dc,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde6c581c-f8') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde6c581c-f8, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde6c581c-f8, col_values=(('external_ids', {'iface-id': 'de6c581c-f84d-4519-9cd7-7f81b40870dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:d6:db', 'vm-uuid': 'a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:44 user nova-compute[73029]: INFO os_vif [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:db,bridge_name='br-int',has_traffic_filtering=True,id=de6c581c-f84d-4519-9cd7-7f81b40870dc,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde6c581c-f8')
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No VIF found with MAC fa:16:3e:86:d6:db, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.neutron [req-02d647b6-91a3-4c9d-b007-5a8b67095a67 req-49897596-5a3d-48e5-afae-d59abc7a9826 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updated VIF entry in instance network info cache for port de6c581c-f84d-4519-9cd7-7f81b40870dc. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:33:44 user nova-compute[73029]: DEBUG nova.network.neutron [req-02d647b6-91a3-4c9d-b007-5a8b67095a67 req-49897596-5a3d-48e5-afae-d59abc7a9826 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating instance_info_cache with network_info: [{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:33:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-02d647b6-91a3-4c9d-b007-5a8b67095a67 req-49897596-5a3d-48e5-afae-d59abc7a9826 service nova] Releasing lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:33:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-7e26f0bc-1f46-4bfe-8b95-678199da56ff req-e524b3c3-375c-4300-903a-e650e4533c1f service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received event network-vif-plugged-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7e26f0bc-1f46-4bfe-8b95-678199da56ff req-e524b3c3-375c-4300-903a-e650e4533c1f service nova] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7e26f0bc-1f46-4bfe-8b95-678199da56ff req-e524b3c3-375c-4300-903a-e650e4533c1f service nova] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:46 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-7e26f0bc-1f46-4bfe-8b95-678199da56ff req-e524b3c3-375c-4300-903a-e650e4533c1f service nova] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:46 user nova-compute[73029]: DEBUG nova.compute.manager [req-7e26f0bc-1f46-4bfe-8b95-678199da56ff req-e524b3c3-375c-4300-903a-e650e4533c1f service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] No waiting events found dispatching network-vif-plugged-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:33:46 user nova-compute[73029]: WARNING nova.compute.manager [req-7e26f0bc-1f46-4bfe-8b95-678199da56ff req-e524b3c3-375c-4300-903a-e650e4533c1f service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received unexpected event network-vif-plugged-de6c581c-f84d-4519-9cd7-7f81b40870dc for instance with vm_state building and task_state spawning.
Aug 10 01:33:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631228.108639, a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:33:48 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] VM Resumed (Lifecycle Event)
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:33:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Instance spawned successfully.
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:33:48 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631228.1116948, a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:33:48 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] VM Started (Lifecycle Event)
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:33:48 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:33:48 user nova-compute[73029]: INFO nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:33:48 user nova-compute[73029]: INFO nova.compute.manager [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Took 6.32 seconds to build instance.
Aug 10 01:33:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-4562faec-f2aa-4e09-9cd0-5d9593e15a3d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.424s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.209s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-e0d45609-c5ac-4cdf-acc1-089e0d35f736 req-b611abc6-4a3f-40a4-a9be-2375fc9bbffd service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received event network-vif-plugged-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e0d45609-c5ac-4cdf-acc1-089e0d35f736 req-b611abc6-4a3f-40a4-a9be-2375fc9bbffd service nova] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e0d45609-c5ac-4cdf-acc1-089e0d35f736 req-b611abc6-4a3f-40a4-a9be-2375fc9bbffd service nova] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e0d45609-c5ac-4cdf-acc1-089e0d35f736 req-b611abc6-4a3f-40a4-a9be-2375fc9bbffd service nova] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG nova.compute.manager [req-e0d45609-c5ac-4cdf-acc1-089e0d35f736 req-b611abc6-4a3f-40a4-a9be-2375fc9bbffd service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] No waiting events found dispatching network-vif-plugged-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:33:48 user nova-compute[73029]: WARNING nova.compute.manager [req-e0d45609-c5ac-4cdf-acc1-089e0d35f736 req-b611abc6-4a3f-40a4-a9be-2375fc9bbffd service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received unexpected event network-vif-plugged-de6c581c-f84d-4519-9cd7-7f81b40870dc for instance with vm_state active and task_state None.
Aug 10 01:33:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:33:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:33:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:33:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:34:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:34:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:13 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:34:13 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:34:13 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8618MB free_disk=25.03365707397461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:34:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:34:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 164e6c98-8a6e-43b3-a5f7-b796a82126bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:34:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:34:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:34:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:34:14 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:34:14 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:34:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:34:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:34:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:34:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:34:24 user nova-compute[73029]: INFO nova.compute.manager [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Terminating instance
Aug 10 01:34:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-d855013b-2a85-4787-b91a-5c7e59f17855 req-f23251b2-e305-421f-bd26-86fe674b8b7b service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received event network-vif-unplugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d855013b-2a85-4787-b91a-5c7e59f17855 req-f23251b2-e305-421f-bd26-86fe674b8b7b service nova] Acquiring lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d855013b-2a85-4787-b91a-5c7e59f17855 req-f23251b2-e305-421f-bd26-86fe674b8b7b service nova] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d855013b-2a85-4787-b91a-5c7e59f17855 req-f23251b2-e305-421f-bd26-86fe674b8b7b service nova] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-d855013b-2a85-4787-b91a-5c7e59f17855 req-f23251b2-e305-421f-bd26-86fe674b8b7b service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] No waiting events found dispatching network-vif-unplugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG nova.compute.manager [req-d855013b-2a85-4787-b91a-5c7e59f17855 req-f23251b2-e305-421f-bd26-86fe674b8b7b service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received event network-vif-unplugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:24 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Instance destroyed successfully.
Aug 10 01:34:24 user nova-compute[73029]: DEBUG nova.objects.instance [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'resources' on Instance uuid 164e6c98-8a6e-43b3-a5f7-b796a82126bb {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1589801589',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1589801589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1589801589',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI2Dob9ZbLxA/zX97v4B++84lsPYubGdpfTA2XnZejev5C4nV4ltdYAjojJu14M84IDBpO60u2G55gNZv1FVda7f4yo0R7ufjzBKpaRqsyRTy83wITiKbkishp/MSqiUA==',key_name='tempest-keypair-2083881660',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-e9m4ebzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=164e6c98-8a6e-43b3-a5f7-b796a82126bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "address": "fa:16:3e:0f:2c:49", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13c3a6-38", "ovs_interfaceid": "6b13c3a6-38a9-4943-87bb-1e9a2db38da7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:2c:49,bridge_name='br-int',has_traffic_filtering=True,id=6b13c3a6-38a9-4943-87bb-1e9a2db38da7,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13c3a6-38') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_vif [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:2c:49,bridge_name='br-int',has_traffic_filtering=True,id=6b13c3a6-38a9-4943-87bb-1e9a2db38da7,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13c3a6-38') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b13c3a6-38, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:34:25 user nova-compute[73029]: INFO os_vif [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:2c:49,bridge_name='br-int',has_traffic_filtering=True,id=6b13c3a6-38a9-4943-87bb-1e9a2db38da7,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13c3a6-38')
Aug 10 01:34:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glcLfdnv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:34:25 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2df868-93e9-4e30-b6b8-aae96c0cc525]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd309e6b-bca3-4fed-acf6-89488b6c468a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:34:25 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 (non-flash)
Aug 10 01:34:25 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f0795510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bdfcd2-72bc-4d78-8998-eed0fd9ac338]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d22664b-0f35-429d-a522-e232e418fd31]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[00538a7e-3b03-4570-bd1b-9630e6bdd2d6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda36786-9a5d-4e16-8ce7-4d80b255f0a9]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ac37feb6', '/dev/disk/by-id/scsi-1SCST_BIOac37feb6-baf05f5e70e5f6a2', '/dev/disk/by-id/scsi-26261663035663565') {{(pid=84041) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc98fda-307b-41ba-9cac-1e8d27ce720f]: (4, None) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c5d1be-79f2-4e13-9a69-2d37af8d1468]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cff9ccc-c827-4fa3-90dd-78f97fdcfa1b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2, portal: 172.16.0.220,3260]
Aug 10 01:34:25 user nova-compute[73029]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2, portal: 172.16.0.220,3260] successful.
Aug 10 01:34:25 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a47efa-4dab-45c6-98a0-857046e841a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f80b9e-6561-477c-a315-4823970ed803]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== disconnect_volume: return (257ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:34:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Deleting instance files /opt/stack/data/nova/instances/164e6c98-8a6e-43b3-a5f7-b796a82126bb_del
Aug 10 01:34:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Deletion of /opt/stack/data/nova/instances/164e6c98-8a6e-43b3-a5f7-b796a82126bb_del complete
Aug 10 01:34:25 user nova-compute[73029]: INFO nova.compute.manager [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 10 01:34:25 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:34:25 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:34:26 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:34:26 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Took 0.80 seconds to deallocate network for instance.
Aug 10 01:34:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-d2f7057f-c417-473c-8ddf-4aff42c197a0 req-f9fa7dfe-baa1-432c-8369-6d11ea0e852e service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received event network-vif-deleted-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:34:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-3ce1ed65-e6a5-4784-9dc4-56467edc287e req-e11b98b4-88e2-4763-8f16-da98d0111e15 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received event network-vif-plugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:34:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3ce1ed65-e6a5-4784-9dc4-56467edc287e req-e11b98b4-88e2-4763-8f16-da98d0111e15 service nova] Acquiring lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:34:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3ce1ed65-e6a5-4784-9dc4-56467edc287e req-e11b98b4-88e2-4763-8f16-da98d0111e15 service nova] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:34:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3ce1ed65-e6a5-4784-9dc4-56467edc287e req-e11b98b4-88e2-4763-8f16-da98d0111e15 service nova] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:34:26 user nova-compute[73029]: DEBUG nova.compute.manager [req-3ce1ed65-e6a5-4784-9dc4-56467edc287e req-e11b98b4-88e2-4763-8f16-da98d0111e15 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] No waiting events found dispatching network-vif-plugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:34:26 user nova-compute[73029]: WARNING nova.compute.manager [req-3ce1ed65-e6a5-4784-9dc4-56467edc287e req-e11b98b4-88e2-4763-8f16-da98d0111e15 service nova] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Received unexpected event network-vif-plugged-6b13c3a6-38a9-4943-87bb-1e9a2db38da7 for instance with vm_state active and task_state deleting.
Aug 10 01:34:27 user nova-compute[73029]: INFO nova.compute.manager [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Took 0.79 seconds to detach 1 volumes for instance.
Aug 10 01:34:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Deleting volume: d8a47efa-4dab-45c6-98a0-857046e841a2 {{(pid=73029) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 10 01:34:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:34:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:34:27 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:34:27 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:34:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:34:27 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Deleted allocations for instance 164e6c98-8a6e-43b3-a5f7-b796a82126bb
Aug 10 01:34:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-1b129c12-5a5d-435a-a797-17d8a8fae102 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "164e6c98-8a6e-43b3-a5f7-b796a82126bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.255s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:34:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:34:39 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691631264.985839, 164e6c98-8a6e-43b3-a5f7-b796a82126bb => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:34:39 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] VM Stopped (Lifecycle Event)
Aug 10 01:34:40 user nova-compute[73029]: DEBUG nova.compute.manager [None req-ae9287a8-5482-4305-bc97-8ff8a9dac2bd None None] [instance: 164e6c98-8a6e-43b3-a5f7-b796a82126bb] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:34:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:34:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:34:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:34:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:34:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:34:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:34:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:01 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:35:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:35:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:35:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:35:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:35:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:35:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:35:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:35:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:35:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:35:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating instance_info_cache with network_info: [{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:35:13 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:35:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:35:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8708MB free_disk=25.032543182373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:35:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:35:15 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:35:15 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:35:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:35:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:35:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:35:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "2f2277f9-aca9-4e61-adea-70023db86da8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "2f2277f9-aca9-4e61-adea-70023db86da8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:35:27 user nova-compute[73029]: INFO nova.compute.claims [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Claim successful on node user
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:35:27 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:35:27 user nova-compute[73029]: INFO nova.virt.block_device [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Booting with volume a7eb13d8-e332-4ede-9d39-9d603cb50197 at /dev/vda
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.policy [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44698a7ae911479eb2d5d8a8103ac5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b217381b301d4650bc046a0031d044a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG os_brick.utils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1788b700-1b08-4885-86ba-84c42812bd65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a978460-4c64-404c-a1ac-04a4038c1ead]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf360d7-3e4b-4c81-ad37-866c859dc331]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c61225d-870d-449a-8bba-29315fd6ac28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:35:27 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:35:27 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[36581383-5084-4457-8528-ce8ab0e3a3ab]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG os_brick.utils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:35:27 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updating existing volume attachment record: 8d306593-fa6b-4c53-a41e-f251de220813 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:35:28 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Successfully created port: f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Successfully updated port: f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquired lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-76424859-c1a0-4579-9f1b-378044ffcf7c req-d5c5f134-1856-4113-a741-12d84597fbe9 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received event network-changed-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.compute.manager [req-76424859-c1a0-4579-9f1b-378044ffcf7c req-d5c5f134-1856-4113-a741-12d84597fbe9 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Refreshing instance network info cache due to event network-changed-f8e8bb78-dc0c-4c23-949d-900fa047e836. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-76424859-c1a0-4579-9f1b-378044ffcf7c req-d5c5f134-1856-4113-a741-12d84597fbe9 service nova] Acquiring lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updating instance_info_cache with network_info: [{"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Releasing lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Instance network_info: |[{"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-76424859-c1a0-4579-9f1b-378044ffcf7c req-d5c5f134-1856-4113-a741-12d84597fbe9 service nova] Acquired lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.network.neutron [req-76424859-c1a0-4579-9f1b-378044ffcf7c req-d5c5f134-1856-4113-a741-12d84597fbe9 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Refreshing network info cache for port f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.network.neutron [req-76424859-c1a0-4579-9f1b-378044ffcf7c req-d5c5f134-1856-4113-a741-12d84597fbe9 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updated VIF entry in instance network info cache for port f8e8bb78-dc0c-4c23-949d-900fa047e836. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG nova.network.neutron [req-76424859-c1a0-4579-9f1b-378044ffcf7c req-d5c5f134-1856-4113-a741-12d84597fbe9 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updating instance_info_cache with network_info: [{"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:35:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-76424859-c1a0-4579-9f1b-378044ffcf7c req-d5c5f134-1856-4113-a741-12d84597fbe9 service nova] Releasing lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:35:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:35:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-c2c06a7e-bf15-47bb-bd20-f7ca5064ef66 req-c679fc82-7134-4bd1-8e46-5c842e2361dd service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received event network-changed-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:35:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-c2c06a7e-bf15-47bb-bd20-f7ca5064ef66 req-c679fc82-7134-4bd1-8e46-5c842e2361dd service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Refreshing instance network info cache due to event network-changed-de6c581c-f84d-4519-9cd7-7f81b40870dc. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:35:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2c06a7e-bf15-47bb-bd20-f7ca5064ef66 req-c679fc82-7134-4bd1-8e46-5c842e2361dd service nova] Acquiring lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:35:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2c06a7e-bf15-47bb-bd20-f7ca5064ef66 req-c679fc82-7134-4bd1-8e46-5c842e2361dd service nova] Acquired lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:35:33 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2c06a7e-bf15-47bb-bd20-f7ca5064ef66 req-c679fc82-7134-4bd1-8e46-5c842e2361dd service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Refreshing network info cache for port de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'flavor' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:34 user nova-compute[73029]: INFO nova.compute.manager [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Attaching volume 88e4b01a-f955-4340-b5b0-d78bf0414090 to /dev/vdb
Aug 10 01:35:34 user nova-compute[73029]: DEBUG os_brick.utils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb307ad-a3fd-4643-9970-62ab574834d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce679c1f-6b25-4a10-a570-be1fd7c35cbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad417488-4c94-4866-a622-6903c9b6e87a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a45e69-5127-4a26-a39b-ac57fa724154]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:35:34 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[632e024d-e350-4af7-8337-3cb927389089]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG os_brick.utils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating existing volume attachment record: 48db9b7a-9ada-4807-87fb-4d3b53b9565c {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2c06a7e-bf15-47bb-bd20-f7ca5064ef66 req-c679fc82-7134-4bd1-8e46-5c842e2361dd service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updated VIF entry in instance network info cache for port de6c581c-f84d-4519-9cd7-7f81b40870dc. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-c2c06a7e-bf15-47bb-bd20-f7ca5064ef66 req-c679fc82-7134-4bd1-8e46-5c842e2361dd service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating instance_info_cache with network_info: [{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:35:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c2c06a7e-bf15-47bb-bd20-f7ca5064ef66 req-c679fc82-7134-4bd1-8e46-5c842e2361dd service nova] Releasing lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:35:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:35:36 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Creating image(s)
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Ensure instance console log exists: /opt/stack/data/nova/instances/2f2277f9-aca9-4e61-adea-70023db86da8/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Start _get_guest_xml network_info=[{"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '8d306593-fa6b-4c53-a41e-f251de220813', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEMsZkJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f2277f9-aca9-4e61-adea-70023db86da8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7eb13d8-e332-4ede-9d39-9d603cb50197', 'serial': 'a7eb13d8-e332-4ede-9d39-9d603cb50197'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:35:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:35:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEMsZkJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:35:36 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:35:36 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:35:36 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a83b863-791a-4a12-b45e-96b5d6ce4f95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:35:36 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bfa87f-e729-428a-ab24-42b6882ddb35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197] added
Aug 10 01:35:36 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cd4079-b2ac-41a6-a50d-b5b3c313a259]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb774de4-440b-4843-8e0b-2ca099e08512]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEMsZkJq {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEMsZkJq" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81bf78c-e1ca-4bff-847d-a1aeacca80bc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TEMsZkJq'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a16ecd4-755e-460a-8da7-703ae8b7042e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd215b34-20a4-474b-8a56-02a20564c5b8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:35:36 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:35:36 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:35:36 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:35:36 user nova-compute[73029]: 
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8f9eaa-0ed3-42c7-9e59-dc7dbde59e04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260]
Aug 10 01:35:36 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260] successful.
Aug 10 01:35:36 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.094s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8cbe6c-b3f1-4475-bccb-920e3895a9fc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c041df91-eb21-41e2-821b-cdf2cce75947]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:35:36 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:35:36 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3f9d14-954e-43af-9245-ca808dfef7e8]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:35:36 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEMsZkJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26266336239303336', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266336239303336', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-380989185',display_name='tempest-TestVolumeBootPattern-server-380989185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-380989185',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsN3fyjSXLeCAvLwIFHAU50CtGMLPOymRkuIm3USr6fHM9U54knreLKzrTnyfmMAZntkzxCoQ4pgf2Dl+Es17Bzu9e/k9ShzPAEQSs6hilfL5Bjdq5fcf2C+5KqnZtUA==',key_name='tempest-TestVolumeBootPattern-1218773818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-h4vqg6rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:35:28Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=2f2277f9-aca9-4e61-adea-70023db86da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:97:07,bridge_name='br-int',has_traffic_filtering=True,id=f8e8bb78-dc0c-4c23-949d-900fa047e836,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e8bb78-dc') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.objects.instance [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f2277f9-aca9-4e61-adea-70023db86da8 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:35:37 user nova-compute[73029]:   <uuid>2f2277f9-aca9-4e61-adea-70023db86da8</uuid>
Aug 10 01:35:37 user nova-compute[73029]:   <name>instance-00000030</name>
Aug 10 01:35:37 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:35:37 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:35:37 user nova-compute[73029]:   <metadata>
Aug 10 01:35:37 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:35:37 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:35:37 user nova-compute[73029]:       <nova:name>tempest-TestVolumeBootPattern-server-380989185</nova:name>
Aug 10 01:35:37 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:35:36</nova:creationTime>
Aug 10 01:35:37 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:35:37 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:35:37 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:35:37 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:35:37 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:35:37 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:35:37 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:35:37 user nova-compute[73029]:       <nova:owner>
Aug 10 01:35:37 user nova-compute[73029]:         <nova:user uuid="44698a7ae911479eb2d5d8a8103ac5dd">tempest-TestVolumeBootPattern-1870123799-project-member</nova:user>
Aug 10 01:35:37 user nova-compute[73029]:         <nova:project uuid="b217381b301d4650bc046a0031d044a7">tempest-TestVolumeBootPattern-1870123799</nova:project>
Aug 10 01:35:37 user nova-compute[73029]:       </nova:owner>
Aug 10 01:35:37 user nova-compute[73029]:       <nova:ports>
Aug 10 01:35:37 user nova-compute[73029]:         <nova:port uuid="f8e8bb78-dc0c-4c23-949d-900fa047e836">
Aug 10 01:35:37 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 01:35:37 user nova-compute[73029]:         </nova:port>
Aug 10 01:35:37 user nova-compute[73029]:       </nova:ports>
Aug 10 01:35:37 user nova-compute[73029]:     </nova:instance>
Aug 10 01:35:37 user nova-compute[73029]:   </metadata>
Aug 10 01:35:37 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:35:37 user nova-compute[73029]:     <system>
Aug 10 01:35:37 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:35:37 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:35:37 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:35:37 user nova-compute[73029]:       <entry name="serial">2f2277f9-aca9-4e61-adea-70023db86da8</entry>
Aug 10 01:35:37 user nova-compute[73029]:       <entry name="uuid">2f2277f9-aca9-4e61-adea-70023db86da8</entry>
Aug 10 01:35:37 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:35:37 user nova-compute[73029]:     </system>
Aug 10 01:35:37 user nova-compute[73029]:   </sysinfo>
Aug 10 01:35:37 user nova-compute[73029]:   <os>
Aug 10 01:35:37 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:35:37 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:35:37 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:35:37 user nova-compute[73029]:   </os>
Aug 10 01:35:37 user nova-compute[73029]:   <features>
Aug 10 01:35:37 user nova-compute[73029]:     <acpi/>
Aug 10 01:35:37 user nova-compute[73029]:     <apic/>
Aug 10 01:35:37 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:35:37 user nova-compute[73029]:   </features>
Aug 10 01:35:37 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:35:37 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:35:37 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:35:37 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:35:37 user nova-compute[73029]:   </clock>
Aug 10 01:35:37 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:35:37 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:35:37 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:35:37 user nova-compute[73029]:   </cpu>
Aug 10 01:35:37 user nova-compute[73029]:   <devices>
Aug 10 01:35:37 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:35:37 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:35:37 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 01:35:37 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:35:37 user nova-compute[73029]:       <serial>a7eb13d8-e332-4ede-9d39-9d603cb50197</serial>
Aug 10 01:35:37 user nova-compute[73029]:     </disk>
Aug 10 01:35:37 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:35:37 user nova-compute[73029]:       <mac address="fa:16:3e:b1:97:07"/>
Aug 10 01:35:37 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:35:37 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:35:37 user nova-compute[73029]:       <target dev="tapf8e8bb78-dc"/>
Aug 10 01:35:37 user nova-compute[73029]:     </interface>
Aug 10 01:35:37 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:35:37 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/2f2277f9-aca9-4e61-adea-70023db86da8/console.log" append="off"/>
Aug 10 01:35:37 user nova-compute[73029]:     </serial>
Aug 10 01:35:37 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:35:37 user nova-compute[73029]:     <video>
Aug 10 01:35:37 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:35:37 user nova-compute[73029]:     </video>
Aug 10 01:35:37 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:35:37 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:35:37 user nova-compute[73029]:     </rng>
Aug 10 01:35:37 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:35:37 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:35:37 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:35:37 user nova-compute[73029]:     </memballoon>
Aug 10 01:35:37 user nova-compute[73029]:   </devices>
Aug 10 01:35:37 user nova-compute[73029]: </domain>
Aug 10 01:35:37 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-380989185',display_name='tempest-TestVolumeBootPattern-server-380989185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-380989185',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsN3fyjSXLeCAvLwIFHAU50CtGMLPOymRkuIm3USr6fHM9U54knreLKzrTnyfmMAZntkzxCoQ4pgf2Dl+Es17Bzu9e/k9ShzPAEQSs6hilfL5Bjdq5fcf2C+5KqnZtUA==',key_name='tempest-TestVolumeBootPattern-1218773818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-h4vqg6rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:35:28Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=2f2277f9-aca9-4e61-adea-70023db86da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:97:07,bridge_name='br-int',has_traffic_filtering=True,id=f8e8bb78-dc0c-4c23-949d-900fa047e836,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e8bb78-dc') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG os_vif [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:97:07,bridge_name='br-int',has_traffic_filtering=True,id=f8e8bb78-dc0c-4c23-949d-900fa047e836,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e8bb78-dc') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8e8bb78-dc, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8e8bb78-dc, col_values=(('external_ids', {'iface-id': 'f8e8bb78-dc0c-4c23-949d-900fa047e836', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:97:07', 'vm-uuid': '2f2277f9-aca9-4e61-adea-70023db86da8'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:37 user nova-compute[73029]: INFO os_vif [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:97:07,bridge_name='br-int',has_traffic_filtering=True,id=f8e8bb78-dc0c-4c23-949d-900fa047e836,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e8bb78-dc')
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:35:37 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No VIF found with MAC fa:16:3e:b1:97:07, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:35:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-bfe24ccb-979a-4485-8119-91bbc97c971e req-e1f451d9-2e2b-4d3c-a807-5011331e2604 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received event network-vif-plugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:35:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bfe24ccb-979a-4485-8119-91bbc97c971e req-e1f451d9-2e2b-4d3c-a807-5011331e2604 service nova] Acquiring lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bfe24ccb-979a-4485-8119-91bbc97c971e req-e1f451d9-2e2b-4d3c-a807-5011331e2604 service nova] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bfe24ccb-979a-4485-8119-91bbc97c971e req-e1f451d9-2e2b-4d3c-a807-5011331e2604 service nova] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-bfe24ccb-979a-4485-8119-91bbc97c971e req-e1f451d9-2e2b-4d3c-a807-5011331e2604 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] No waiting events found dispatching network-vif-plugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:35:39 user nova-compute[73029]: WARNING nova.compute.manager [req-bfe24ccb-979a-4485-8119-91bbc97c971e req-e1f451d9-2e2b-4d3c-a807-5011331e2604 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received unexpected event network-vif-plugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 for instance with vm_state building and task_state spawning.
Aug 10 01:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631341.139376, 2f2277f9-aca9-4e61-adea-70023db86da8 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:35:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] VM Resumed (Lifecycle Event)
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:35:41 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Instance spawned successfully.
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:35:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631341.140717, 2f2277f9-aca9-4e61-adea-70023db86da8 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:35:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] VM Started (Lifecycle Event)
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-ec74e147-1942-494c-8bf0-3e6551fe7a56 req-ab81f9ec-fec0-4196-80b8-1be223085b11 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received event network-vif-plugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ec74e147-1942-494c-8bf0-3e6551fe7a56 req-ab81f9ec-fec0-4196-80b8-1be223085b11 service nova] Acquiring lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ec74e147-1942-494c-8bf0-3e6551fe7a56 req-ab81f9ec-fec0-4196-80b8-1be223085b11 service nova] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ec74e147-1942-494c-8bf0-3e6551fe7a56 req-ab81f9ec-fec0-4196-80b8-1be223085b11 service nova] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.compute.manager [req-ec74e147-1942-494c-8bf0-3e6551fe7a56 req-ab81f9ec-fec0-4196-80b8-1be223085b11 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] No waiting events found dispatching network-vif-plugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:35:41 user nova-compute[73029]: WARNING nova.compute.manager [req-ec74e147-1942-494c-8bf0-3e6551fe7a56 req-ab81f9ec-fec0-4196-80b8-1be223085b11 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received unexpected event network-vif-plugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 for instance with vm_state building and task_state spawning.
Aug 10 01:35:41 user nova-compute[73029]: INFO nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 10 01:35:41 user nova-compute[73029]: DEBUG nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:35:41 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:35:41 user nova-compute[73029]: INFO nova.compute.manager [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Took 13.96 seconds to build instance.
Aug 10 01:35:41 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-7d895061-a53c-44b4-b2c9-bf0ab2589864 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "2f2277f9-aca9-4e61-adea-70023db86da8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.079s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPFjsTCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:35:43 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:35:43 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:35:43 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a85581-0630-42ee-933a-e4017b0d6486]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:35:43 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[382d31b7-98be-4c9d-bfc3-6aaad2f8b563]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090] added
Aug 10 01:35:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3566a02c-db25-4d8e-8044-51d0cf60f96d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8993c004-06eb-4501-b5bb-1cd75c6751ff]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPFjsTCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPFjsTCE" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0262c221-f4d6-4329-9844-d47064ded83d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPFjsTCE'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb1e519-41df-4c48-ac6a-3f19b8c8368d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b69d54c-1516-480d-bd90-ee2bb730c58c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:35:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:35:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11883ee-f0a9-45d7-82c7-3ec36722e38d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090, portal: 172.16.0.220,3260]
Aug 10 01:35:43 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090, portal: 172.16.0.220,3260] successful.
Aug 10 01:35:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[431020f4-c43c-4722-92f5-adfc1adb6343]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eb7bcd-aafa-45bb-ae7e-42ef75044e7d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:35:43 user nova-compute[73029]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 (non-flash)
Aug 10 01:35:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:35:43 user nova-compute[73029]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 (non-flash)
Aug 10 01:35:43 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8eed1e-f20f-45dc-8e10-fa261754502a]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:43 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:35:44 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:35:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPFjsTCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:35:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:35:44 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26564663937346136', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:35:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564663937346136', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:35:44 user nova-compute[73029]: DEBUG nova.objects.instance [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'flavor' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:35:44 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:35:44 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:35:44 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 01:35:44 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:35:44 user nova-compute[73029]:   <serial>88e4b01a-f955-4340-b5b0-d78bf0414090</serial>
Aug 10 01:35:44 user nova-compute[73029]: </disk>
Aug 10 01:35:44 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:35:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:35:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:35:45 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No VIF found with MAC fa:16:3e:86:d6:db, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:35:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ec4-dbdb-4d76-9d39-0193140cd314 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.892s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:35:48 user nova-compute[73029]: INFO nova.compute.manager [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Detaching volume 88e4b01a-f955-4340-b5b0-d78bf0414090
Aug 10 01:35:48 user nova-compute[73029]: INFO nova.virt.block_device [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Attempting to driver detach volume 88e4b01a-f955-4340-b5b0-d78bf0414090 from mountpoint /dev/vdb
Aug 10 01:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Attempting to detach device vdb from instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:35:48 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:35:48 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 01:35:48 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:35:48 user nova-compute[73029]:   <serial>88e4b01a-f955-4340-b5b0-d78bf0414090</serial>
Aug 10 01:35:48 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:35:48 user nova-compute[73029]: </disk>
Aug 10 01:35:48 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:35:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Successfully detached device vdb from instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 from the persistent domain config.
Aug 10 01:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:35:48 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:35:48 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 01:35:48 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:35:48 user nova-compute[73029]:   <serial>88e4b01a-f955-4340-b5b0-d78bf0414090</serial>
Aug 10 01:35:48 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:35:48 user nova-compute[73029]: </disk>
Aug 10 01:35:48 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691631348.6400187, a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:35:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Successfully detached device vdb from instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 from the live domain config.
Aug 10 01:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPFjsTCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:35:48 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[16115f80-07db-49f3-9385-b1306ac8ce91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bad736-f80c-4bab-ba86-bc134d617565]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:35:48 user nova-compute[73029]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 (non-flash)
Aug 10 01:35:48 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:35:48 user nova-compute[73029]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 (non-flash)
Aug 10 01:35:48 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f078d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c8bc68-d2a1-4937-9bdd-4989fe6b6982]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[885928ab-2b36-4ec9-aa79-9544d53fe4a5]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b240c0-05d0-431a-9310-db69f734cd41]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd0b423-8ed8-4cba-bf58-52de815c2b76]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[661e2216-3879-4b61-bb30-ab84ecc519b4]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11ac591-37fd-4da8-96c5-6c30617dd2b6]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090, portal: 172.16.0.220,3260]
Aug 10 01:35:48 user nova-compute[73029]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090, portal: 172.16.0.220,3260] successful.
Aug 10 01:35:48 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e4b01a-f955-4340-b5b0-d78bf0414090 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f8946-05a5-4351-aa51-d4ba27b9d377]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.237s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] <== disconnect_volume: return (238ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:35:48 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:35:49 user nova-compute[73029]: DEBUG nova.objects.instance [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'flavor' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:35:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-b6b96bfb-260f-4491-9b67-9b1e0e2e5968 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.523s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:35:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:35:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:36:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:36:14 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8604MB free_disk=25.029834747314453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 2f2277f9-aca9-4e61-adea-70023db86da8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:36:14 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:36:15 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:36:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating instance_info_cache with network_info: [{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:36:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:36:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:36:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:36:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:36:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:36:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:36:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:36:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:36:45 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:36:45 user nova-compute[73029]: INFO nova.compute.manager [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] instance snapshotting
Aug 10 01:36:45 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Beginning live snapshot process
Aug 10 01:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json -f qcow2 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json -f qcow2 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwx7qcdol/476dc4b237ac41d287fb5d85f4803f1d.delta 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwx7qcdol/476dc4b237ac41d287fb5d85f4803f1d.delta 1073741824" returned: 0 in 0.055s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:46 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 10 01:36:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 01:36:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:47 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73029) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 10 01:36:47 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 10 01:36:47 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 01:36:47 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwx7qcdol/476dc4b237ac41d287fb5d85f4803f1d.delta /opt/stack/data/nova/instances/snapshots/tmpwx7qcdol/476dc4b237ac41d287fb5d85f4803f1d {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:48 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwx7qcdol/476dc4b237ac41d287fb5d85f4803f1d.delta /opt/stack/data/nova/instances/snapshots/tmpwx7qcdol/476dc4b237ac41d287fb5d85f4803f1d" returned: 0 in 0.536s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:48 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Snapshot extracted, beginning image upload
Aug 10 01:36:51 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Snapshot image upload complete
Aug 10 01:36:51 user nova-compute[73029]: INFO nova.compute.manager [None req-e46f8355-a7d0-4b1d-83a3-6411c1f78a4f tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Took 5.36 seconds to snapshot the instance on the hypervisor.
Aug 10 01:36:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:36:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:36:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:36:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:36:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:36:53 user nova-compute[73029]: INFO nova.compute.claims [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Claim successful on node user
Aug 10 01:36:53 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:36:53 user nova-compute[73029]: DEBUG nova.network.neutron [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:36:53 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:36:53 user nova-compute[73029]: DEBUG nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:36:54 user nova-compute[73029]: DEBUG nova.policy [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78c0f17ce2de4d6e9157b86db5d1a59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9215a23c39a8459189ebc450d8e8c04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:36:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:36:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:36:54 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Creating image(s)
Aug 10 01:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "/opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "/opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "/opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "865f592c527ca81cc950482e21efd2dc4909aaed" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:36:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "865f592c527ca81cc950482e21efd2dc4909aaed" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:36:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed.part --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:55 user nova-compute[73029]: DEBUG nova.network.neutron [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Successfully created port: 4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:36:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed.part --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:55 user nova-compute[73029]: DEBUG nova.virt.images [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] 72f9901b-3fdf-4473-8e4b-322e34a9f18b was qcow2, converting to raw {{(pid=73029) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 10 01:36:55 user nova-compute[73029]: DEBUG nova.privsep.utils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73029) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 10 01:36:55 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed.part /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed.converted {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed.part /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed.converted" returned: 0 in 0.832s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed.converted --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "865f592c527ca81cc950482e21efd2dc4909aaed" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.272s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Successfully updated port: 4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "865f592c527ca81cc950482e21efd2dc4909aaed" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "865f592c527ca81cc950482e21efd2dc4909aaed" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquired lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-0b2863e8-7ef6-444b-9374-0c521b636c37 req-054dcef1-dcd2-4542-8069-9181d80324a4 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received event network-changed-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-0b2863e8-7ef6-444b-9374-0c521b636c37 req-054dcef1-dcd2-4542-8069-9181d80324a4 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Refreshing instance network info cache due to event network-changed-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0b2863e8-7ef6-444b-9374-0c521b636c37 req-054dcef1-dcd2-4542-8069-9181d80324a4 service nova] Acquiring lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed,backing_fmt=raw /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed,backing_fmt=raw /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk 1073741824" returned: 0 in 0.055s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "865f592c527ca81cc950482e21efd2dc4909aaed" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.objects.instance [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'migration_context' on Instance uuid db0fae65-f803-4c38-821d-43a05864ee1d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Ensure instance console log exists: /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.network.neutron [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updating instance_info_cache with network_info: [{"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Releasing lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Instance network_info: |[{"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0b2863e8-7ef6-444b-9374-0c521b636c37 req-054dcef1-dcd2-4542-8069-9181d80324a4 service nova] Acquired lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.network.neutron [req-0b2863e8-7ef6-444b-9374-0c521b636c37 req-054dcef1-dcd2-4542-8069-9181d80324a4 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Refreshing network info cache for port 4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Start _get_guest_xml network_info=[{"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1fef7a83c34a517415ecf6018699d4da',container_format='bare',created_at=2023-08-10T01:36:46Z,direct_url=<?>,disk_format='qcow2',id=72f9901b-3fdf-4473-8e4b-322e34a9f18b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-648913564',owner='9215a23c39a8459189ebc450d8e8c04a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-10T01:36:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '72f9901b-3fdf-4473-8e4b-322e34a9f18b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:36:56 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:36:56 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1fef7a83c34a517415ecf6018699d4da',container_format='bare',created_at=2023-08-10T01:36:46Z,direct_url=<?>,disk_format='qcow2',id=72f9901b-3fdf-4473-8e4b-322e34a9f18b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-648913564',owner='9215a23c39a8459189ebc450d8e8c04a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-10T01:36:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:36:56 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1797206433',display_name='tempest-TestStampPattern-server-1797206433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1797206433',id=49,image_ref='72f9901b-3fdf-4473-8e4b-322e34a9f18b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAddBkpSKohxYOXkI3rImgDqSstvP3ZRXcIf/qUsLQoP0yH4xe/0HVF+nDjSxI3MoMcBmnNa4AjB+RjR3Qrtfpqu5nAJJmTCSg0WHfY3z/SYwdN1kQs2MBTqdEgrMr0vg==',key_name='tempest-TestStampPattern-2134481350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9215a23c39a8459189ebc450d8e8c04a',ramdisk_id='',reservation_id='r-r1gzbz3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7',image_min_disk='1',image_min_ram='0',image_owner_id='9215a23c39a8459189ebc450d8e8c04a',image_owner_project_name='tempest-TestStampPattern-174573223',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-174573223-project-member',image_user_id='78c0f17ce2de4d6e9157b86db5d1a59e',network_allocated='True',owner_project_name='tempest-TestStampPattern-174573223',owner_user_name='tempest-TestStampPattern-174573223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:36:54Z,user_data=None,user_id='78c0f17ce2de4d6e9157b86db5d1a59e',uuid=db0fae65-f803-4c38-821d-43a05864ee1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converting VIF {"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:27:de,bridge_name='br-int',has_traffic_filtering=True,id=4c1e7446-8bc2-4fcf-8d0c-d24542d75d51,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e7446-8b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.objects.instance [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'pci_devices' on Instance uuid db0fae65-f803-4c38-821d-43a05864ee1d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:36:57 user nova-compute[73029]:   <uuid>db0fae65-f803-4c38-821d-43a05864ee1d</uuid>
Aug 10 01:36:57 user nova-compute[73029]:   <name>instance-00000031</name>
Aug 10 01:36:57 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:36:57 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:36:57 user nova-compute[73029]:   <metadata>
Aug 10 01:36:57 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:36:57 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:36:57 user nova-compute[73029]:       <nova:name>tempest-TestStampPattern-server-1797206433</nova:name>
Aug 10 01:36:57 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:36:56</nova:creationTime>
Aug 10 01:36:57 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:36:57 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:36:57 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:36:57 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:36:57 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:36:57 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:36:57 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:36:57 user nova-compute[73029]:       <nova:owner>
Aug 10 01:36:57 user nova-compute[73029]:         <nova:user uuid="78c0f17ce2de4d6e9157b86db5d1a59e">tempest-TestStampPattern-174573223-project-member</nova:user>
Aug 10 01:36:57 user nova-compute[73029]:         <nova:project uuid="9215a23c39a8459189ebc450d8e8c04a">tempest-TestStampPattern-174573223</nova:project>
Aug 10 01:36:57 user nova-compute[73029]:       </nova:owner>
Aug 10 01:36:57 user nova-compute[73029]:       <nova:root type="image" uuid="72f9901b-3fdf-4473-8e4b-322e34a9f18b"/>
Aug 10 01:36:57 user nova-compute[73029]:       <nova:ports>
Aug 10 01:36:57 user nova-compute[73029]:         <nova:port uuid="4c1e7446-8bc2-4fcf-8d0c-d24542d75d51">
Aug 10 01:36:57 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 10 01:36:57 user nova-compute[73029]:         </nova:port>
Aug 10 01:36:57 user nova-compute[73029]:       </nova:ports>
Aug 10 01:36:57 user nova-compute[73029]:     </nova:instance>
Aug 10 01:36:57 user nova-compute[73029]:   </metadata>
Aug 10 01:36:57 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:36:57 user nova-compute[73029]:     <system>
Aug 10 01:36:57 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:36:57 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:36:57 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:36:57 user nova-compute[73029]:       <entry name="serial">db0fae65-f803-4c38-821d-43a05864ee1d</entry>
Aug 10 01:36:57 user nova-compute[73029]:       <entry name="uuid">db0fae65-f803-4c38-821d-43a05864ee1d</entry>
Aug 10 01:36:57 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:36:57 user nova-compute[73029]:     </system>
Aug 10 01:36:57 user nova-compute[73029]:   </sysinfo>
Aug 10 01:36:57 user nova-compute[73029]:   <os>
Aug 10 01:36:57 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:36:57 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:36:57 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:36:57 user nova-compute[73029]:   </os>
Aug 10 01:36:57 user nova-compute[73029]:   <features>
Aug 10 01:36:57 user nova-compute[73029]:     <acpi/>
Aug 10 01:36:57 user nova-compute[73029]:     <apic/>
Aug 10 01:36:57 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:36:57 user nova-compute[73029]:   </features>
Aug 10 01:36:57 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:36:57 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:36:57 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:36:57 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:36:57 user nova-compute[73029]:   </clock>
Aug 10 01:36:57 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:36:57 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:36:57 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:36:57 user nova-compute[73029]:   </cpu>
Aug 10 01:36:57 user nova-compute[73029]:   <devices>
Aug 10 01:36:57 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:36:57 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:36:57 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk"/>
Aug 10 01:36:57 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:36:57 user nova-compute[73029]:     </disk>
Aug 10 01:36:57 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:36:57 user nova-compute[73029]:       <mac address="fa:16:3e:3d:27:de"/>
Aug 10 01:36:57 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:36:57 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:36:57 user nova-compute[73029]:       <target dev="tap4c1e7446-8b"/>
Aug 10 01:36:57 user nova-compute[73029]:     </interface>
Aug 10 01:36:57 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:36:57 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/console.log" append="off"/>
Aug 10 01:36:57 user nova-compute[73029]:     </serial>
Aug 10 01:36:57 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:36:57 user nova-compute[73029]:     <video>
Aug 10 01:36:57 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:36:57 user nova-compute[73029]:     </video>
Aug 10 01:36:57 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:36:57 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:36:57 user nova-compute[73029]:     </rng>
Aug 10 01:36:57 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:36:57 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:36:57 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:36:57 user nova-compute[73029]:     </memballoon>
Aug 10 01:36:57 user nova-compute[73029]:   </devices>
Aug 10 01:36:57 user nova-compute[73029]: </domain>
Aug 10 01:36:57 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1797206433',display_name='tempest-TestStampPattern-server-1797206433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1797206433',id=49,image_ref='72f9901b-3fdf-4473-8e4b-322e34a9f18b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAddBkpSKohxYOXkI3rImgDqSstvP3ZRXcIf/qUsLQoP0yH4xe/0HVF+nDjSxI3MoMcBmnNa4AjB+RjR3Qrtfpqu5nAJJmTCSg0WHfY3z/SYwdN1kQs2MBTqdEgrMr0vg==',key_name='tempest-TestStampPattern-2134481350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9215a23c39a8459189ebc450d8e8c04a',ramdisk_id='',reservation_id='r-r1gzbz3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7',image_min_disk='1',image_min_ram='0',image_owner_id='9215a23c39a8459189ebc450d8e8c04a',image_owner_project_name='tempest-TestStampPattern-174573223',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-174573223-project-member',image_user_id='78c0f17ce2de4d6e9157b86db5d1a59e',network_allocated='True',owner_project_name='tempest-TestStampPattern-174573223',owner_user_name='tempest-TestStampPattern-174573223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:36:54Z,user_data=None,user_id='78c0f17ce2de4d6e9157b86db5d1a59e',uuid=db0fae65-f803-4c38-821d-43a05864ee1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converting VIF {"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:27:de,bridge_name='br-int',has_traffic_filtering=True,id=4c1e7446-8bc2-4fcf-8d0c-d24542d75d51,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e7446-8b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG os_vif [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:27:de,bridge_name='br-int',has_traffic_filtering=True,id=4c1e7446-8bc2-4fcf-8d0c-d24542d75d51,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e7446-8b') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c1e7446-8b, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c1e7446-8b, col_values=(('external_ids', {'iface-id': '4c1e7446-8bc2-4fcf-8d0c-d24542d75d51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:27:de', 'vm-uuid': 'db0fae65-f803-4c38-821d-43a05864ee1d'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:57 user nova-compute[73029]: INFO os_vif [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:27:de,bridge_name='br-int',has_traffic_filtering=True,id=4c1e7446-8bc2-4fcf-8d0c-d24542d75d51,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e7446-8b')
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No VIF found with MAC fa:16:3e:3d:27:de, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-0b2863e8-7ef6-444b-9374-0c521b636c37 req-054dcef1-dcd2-4542-8069-9181d80324a4 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updated VIF entry in instance network info cache for port 4c1e7446-8bc2-4fcf-8d0c-d24542d75d51. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG nova.network.neutron [req-0b2863e8-7ef6-444b-9374-0c521b636c37 req-054dcef1-dcd2-4542-8069-9181d80324a4 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updating instance_info_cache with network_info: [{"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:36:57 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0b2863e8-7ef6-444b-9374-0c521b636c37 req-054dcef1-dcd2-4542-8069-9181d80324a4 service nova] Releasing lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-db5fac41-ef43-473e-a5d4-344db958d2dc req-c719258c-19d1-4a3f-8eb6-0c3c34a74884 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received event network-vif-plugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-db5fac41-ef43-473e-a5d4-344db958d2dc req-c719258c-19d1-4a3f-8eb6-0c3c34a74884 service nova] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-db5fac41-ef43-473e-a5d4-344db958d2dc req-c719258c-19d1-4a3f-8eb6-0c3c34a74884 service nova] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-db5fac41-ef43-473e-a5d4-344db958d2dc req-c719258c-19d1-4a3f-8eb6-0c3c34a74884 service nova] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:36:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-db5fac41-ef43-473e-a5d4-344db958d2dc req-c719258c-19d1-4a3f-8eb6-0c3c34a74884 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] No waiting events found dispatching network-vif-plugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:36:58 user nova-compute[73029]: WARNING nova.compute.manager [req-db5fac41-ef43-473e-a5d4-344db958d2dc req-c719258c-19d1-4a3f-8eb6-0c3c34a74884 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received unexpected event network-vif-plugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 for instance with vm_state building and task_state spawning.
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631420.4384594, db0fae65-f803-4c38-821d-43a05864ee1d => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:37:00 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] VM Resumed (Lifecycle Event)
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:37:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Instance spawned successfully.
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:37:00 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631420.4388835, db0fae65-f803-4c38-821d-43a05864ee1d => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:37:00 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] VM Started (Lifecycle Event)
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:37:00 user nova-compute[73029]: INFO nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:37:00 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:37:00 user nova-compute[73029]: INFO nova.compute.manager [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Took 6.99 seconds to build instance.
Aug 10 01:37:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-09287d81-d02a-456e-911f-bd9d65446b7d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.089s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-80cb4956-3b4d-4163-aef4-c99db848bb27 req-24a27bb8-bf4d-4ef1-ab84-a45506936ed4 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received event network-vif-plugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-80cb4956-3b4d-4163-aef4-c99db848bb27 req-24a27bb8-bf4d-4ef1-ab84-a45506936ed4 service nova] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-80cb4956-3b4d-4163-aef4-c99db848bb27 req-24a27bb8-bf4d-4ef1-ab84-a45506936ed4 service nova] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-80cb4956-3b4d-4163-aef4-c99db848bb27 req-24a27bb8-bf4d-4ef1-ab84-a45506936ed4 service nova] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:37:00 user nova-compute[73029]: DEBUG nova.compute.manager [req-80cb4956-3b4d-4163-aef4-c99db848bb27 req-24a27bb8-bf4d-4ef1-ab84-a45506936ed4 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] No waiting events found dispatching network-vif-plugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:37:00 user nova-compute[73029]: WARNING nova.compute.manager [req-80cb4956-3b4d-4163-aef4-c99db848bb27 req-24a27bb8-bf4d-4ef1-ab84-a45506936ed4 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received unexpected event network-vif-plugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 for instance with vm_state active and task_state None.
Aug 10 01:37:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:05 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:37:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:17 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:37:17 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8507MB free_disk=24.876266479492188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance 2f2277f9-aca9-4e61-adea-70023db86da8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance db0fae65-f803-4c38-821d-43a05864ee1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:37:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:37:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:37:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:37:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:37:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:37:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updating instance_info_cache with network_info: [{"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:37:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:37:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-47f6076b-e5be-4fa8-8875-2673d06d2387 req-380f9b28-0305-4562-bb57-be8c078187f8 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received event network-changed-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:37:19 user nova-compute[73029]: DEBUG nova.compute.manager [req-47f6076b-e5be-4fa8-8875-2673d06d2387 req-380f9b28-0305-4562-bb57-be8c078187f8 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Refreshing instance network info cache due to event network-changed-f8e8bb78-dc0c-4c23-949d-900fa047e836. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-47f6076b-e5be-4fa8-8875-2673d06d2387 req-380f9b28-0305-4562-bb57-be8c078187f8 service nova] Acquiring lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:37:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-47f6076b-e5be-4fa8-8875-2673d06d2387 req-380f9b28-0305-4562-bb57-be8c078187f8 service nova] Acquired lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:37:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-47f6076b-e5be-4fa8-8875-2673d06d2387 req-380f9b28-0305-4562-bb57-be8c078187f8 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Refreshing network info cache for port f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG nova.network.neutron [req-47f6076b-e5be-4fa8-8875-2673d06d2387 req-380f9b28-0305-4562-bb57-be8c078187f8 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updated VIF entry in instance network info cache for port f8e8bb78-dc0c-4c23-949d-900fa047e836. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG nova.network.neutron [req-47f6076b-e5be-4fa8-8875-2673d06d2387 req-380f9b28-0305-4562-bb57-be8c078187f8 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updating instance_info_cache with network_info: [{"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-47f6076b-e5be-4fa8-8875-2673d06d2387 req-380f9b28-0305-4562-bb57-be8c078187f8 service nova] Releasing lock "refresh_cache-2f2277f9-aca9-4e61-adea-70023db86da8" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "2f2277f9-aca9-4e61-adea-70023db86da8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "2f2277f9-aca9-4e61-adea-70023db86da8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:37:20 user nova-compute[73029]: INFO nova.compute.manager [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Terminating instance
Aug 10 01:37:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-0f7ca95b-5d06-40a4-8c50-6094fa01f8d8 req-51d97ea4-c776-4c82-8c67-8d17eb280d6f service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received event network-vif-unplugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0f7ca95b-5d06-40a4-8c50-6094fa01f8d8 req-51d97ea4-c776-4c82-8c67-8d17eb280d6f service nova] Acquiring lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0f7ca95b-5d06-40a4-8c50-6094fa01f8d8 req-51d97ea4-c776-4c82-8c67-8d17eb280d6f service nova] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-0f7ca95b-5d06-40a4-8c50-6094fa01f8d8 req-51d97ea4-c776-4c82-8c67-8d17eb280d6f service nova] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-0f7ca95b-5d06-40a4-8c50-6094fa01f8d8 req-51d97ea4-c776-4c82-8c67-8d17eb280d6f service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] No waiting events found dispatching network-vif-unplugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:37:20 user nova-compute[73029]: DEBUG nova.compute.manager [req-0f7ca95b-5d06-40a4-8c50-6094fa01f8d8 req-51d97ea4-c776-4c82-8c67-8d17eb280d6f service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received event network-vif-unplugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:37:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Instance destroyed successfully.
Aug 10 01:37:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'resources' on Instance uuid 2f2277f9-aca9-4e61-adea-70023db86da8 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-380989185',display_name='tempest-TestVolumeBootPattern-server-380989185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-380989185',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsN3fyjSXLeCAvLwIFHAU50CtGMLPOymRkuIm3USr6fHM9U54knreLKzrTnyfmMAZntkzxCoQ4pgf2Dl+Es17Bzu9e/k9ShzPAEQSs6hilfL5Bjdq5fcf2C+5KqnZtUA==',key_name='tempest-TestVolumeBootPattern-1218773818',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-h4vqg6rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:35:41Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=2f2277f9-aca9-4e61-adea-70023db86da8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "address": "fa:16:3e:b1:97:07", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e8bb78-dc", "ovs_interfaceid": "f8e8bb78-dc0c-4c23-949d-900fa047e836", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:97:07,bridge_name='br-int',has_traffic_filtering=True,id=f8e8bb78-dc0c-4c23-949d-900fa047e836,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e8bb78-dc') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_vif [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:97:07,bridge_name='br-int',has_traffic_filtering=True,id=f8e8bb78-dc0c-4c23-949d-900fa047e836,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e8bb78-dc') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8e8bb78-dc, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:37:21 user nova-compute[73029]: INFO os_vif [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:97:07,bridge_name='br-int',has_traffic_filtering=True,id=f8e8bb78-dc0c-4c23-949d-900fa047e836,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e8bb78-dc')
Aug 10 01:37:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEMsZkJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:37:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cb2a9c-218d-4003-879a-e5be7135d133]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0672081-f0c1-49aa-92bb-f09115cf6b65]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:37:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:37:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7528c0a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22b0dd-a6da-4ac6-b456-75f26eea2d8f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae345d4-c420-4e5c-910c-fa402d427f72]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[13af5269-67b6-4954-8b2e-664e1e249c82]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[df654503-f489-4d43-bf3e-f2e07e57ef8b]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO587522d4-bf3b903666f8e7cf', '/dev/disk/by-id/scsi-26266336239303336', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_587522d4') {{(pid=84041) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c6355-02a1-4358-816b-5cfc14d0cb38]: (4, None) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf9127-58b2-4cd7-b1bc-3ed290847628]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4d906b-697d-4839-8ba5-1bf0c43e2f15]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260]
Aug 10 01:37:21 user nova-compute[73029]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260] successful.
Aug 10 01:37:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd43e25-30fa-47fd-b859-5a3fca768136]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== disconnect_volume: return (356ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:37:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Deleting instance files /opt/stack/data/nova/instances/2f2277f9-aca9-4e61-adea-70023db86da8_del
Aug 10 01:37:21 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Deletion of /opt/stack/data/nova/instances/2f2277f9-aca9-4e61-adea-70023db86da8_del complete
Aug 10 01:37:21 user nova-compute[73029]: INFO nova.compute.manager [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 10 01:37:21 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:37:21 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:37:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:22 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:37:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-f93121a3-0149-4ae8-8729-5899e3be358b req-748f3f58-b098-4eed-b492-b8584eb7bd5e service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received event network-vif-deleted-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:37:22 user nova-compute[73029]: INFO nova.compute.manager [req-f93121a3-0149-4ae8-8729-5899e3be358b req-748f3f58-b098-4eed-b492-b8584eb7bd5e service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Neutron deleted interface f8e8bb78-dc0c-4c23-949d-900fa047e836; detaching it from the instance and deleting it from the info cache
Aug 10 01:37:22 user nova-compute[73029]: DEBUG nova.network.neutron [req-f93121a3-0149-4ae8-8729-5899e3be358b req-748f3f58-b098-4eed-b492-b8584eb7bd5e service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:37:22 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Took 0.98 seconds to deallocate network for instance.
Aug 10 01:37:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-f93121a3-0149-4ae8-8729-5899e3be358b req-748f3f58-b098-4eed-b492-b8584eb7bd5e service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Detach interface failed, port_id=f8e8bb78-dc0c-4c23-949d-900fa047e836, reason: Instance 2f2277f9-aca9-4e61-adea-70023db86da8 could not be found. {{(pid=73029) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 10 01:37:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-bf679d2a-b793-4e1f-8d48-6724f8d309b3 req-85f2bd1b-5df7-49ae-8374-6bb481d106d7 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received event network-vif-plugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bf679d2a-b793-4e1f-8d48-6724f8d309b3 req-85f2bd1b-5df7-49ae-8374-6bb481d106d7 service nova] Acquiring lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bf679d2a-b793-4e1f-8d48-6724f8d309b3 req-85f2bd1b-5df7-49ae-8374-6bb481d106d7 service nova] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:37:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-bf679d2a-b793-4e1f-8d48-6724f8d309b3 req-85f2bd1b-5df7-49ae-8374-6bb481d106d7 service nova] Lock "2f2277f9-aca9-4e61-adea-70023db86da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:37:22 user nova-compute[73029]: DEBUG nova.compute.manager [req-bf679d2a-b793-4e1f-8d48-6724f8d309b3 req-85f2bd1b-5df7-49ae-8374-6bb481d106d7 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] No waiting events found dispatching network-vif-plugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:37:22 user nova-compute[73029]: WARNING nova.compute.manager [req-bf679d2a-b793-4e1f-8d48-6724f8d309b3 req-85f2bd1b-5df7-49ae-8374-6bb481d106d7 service nova] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Received unexpected event network-vif-plugged-f8e8bb78-dc0c-4c23-949d-900fa047e836 for instance with vm_state active and task_state deleting.
Aug 10 01:37:23 user nova-compute[73029]: INFO nova.compute.manager [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Took 0.76 seconds to detach 1 volumes for instance.
Aug 10 01:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:37:23 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:37:23 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:37:23 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Deleted allocations for instance 2f2277f9-aca9-4e61-adea-70023db86da8
Aug 10 01:37:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-499c25f4-5ee0-49bc-9dcb-f40d1b652e9e tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "2f2277f9-aca9-4e61-adea-70023db86da8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.244s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:37:26 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:31 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:37:36 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691631441.0727544, 2f2277f9-aca9-4e61-adea-70023db86da8 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:37:36 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] VM Stopped (Lifecycle Event)
Aug 10 01:37:36 user nova-compute[73029]: DEBUG nova.compute.manager [None req-5a58bd23-a42e-406a-b7f1-8c36476d2737 None None] [instance: 2f2277f9-aca9-4e61-adea-70023db86da8] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:37:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:37:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:37:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:37:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:37:41 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:37:46 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:37:46 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:37:51 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:37:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:38:01 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:38:05 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:06 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:38:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "be71c328-6449-4440-8d86-a3f72eb315da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:38:12 user nova-compute[73029]: INFO nova.compute.claims [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Claim successful on node user
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.network.neutron [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:38:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:38:12 user nova-compute[73029]: INFO nova.virt.block_device [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Booting with volume a7eb13d8-e332-4ede-9d39-9d603cb50197 at /dev/vda
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.policy [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44698a7ae911479eb2d5d8a8103ac5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b217381b301d4650bc046a0031d044a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG os_brick.utils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[95912834-f73a-4299-b342-a9a828a7a333]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[942390af-7932-45b8-9fa1-0e3c8f72e166]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d71367-e297-4dc0-a918-c2ef6b7f53d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[340baa33-a753-4de1-8e96-677908f6c4f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:38:12 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:38:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9522b7-93af-4d76-a0ea-e25076f103b1]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG os_brick.utils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:38:12 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updating existing volume attachment record: 3ec6678b-f520-4c47-9c63-0fb0178dd113 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:38:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:13 user nova-compute[73029]: DEBUG nova.network.neutron [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Successfully created port: 3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG nova.network.neutron [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Successfully updated port: 3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquired lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG nova.network.neutron [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-fc92aa39-4451-43d1-8540-9ce1c6a251c6 req-931f7426-5bcf-4a92-b796-a4a6f3e1ab1f service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-changed-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG nova.compute.manager [req-fc92aa39-4451-43d1-8540-9ce1c6a251c6 req-931f7426-5bcf-4a92-b796-a4a6f3e1ab1f service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Refreshing instance network info cache due to event network-changed-3da49895-08df-44aa-b649-713fc4d4f25e. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fc92aa39-4451-43d1-8540-9ce1c6a251c6 req-931f7426-5bcf-4a92-b796-a4a6f3e1ab1f service nova] Acquiring lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG nova.network.neutron [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG nova.network.neutron [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updating instance_info_cache with network_info: [{"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Releasing lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Instance network_info: |[{"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fc92aa39-4451-43d1-8540-9ce1c6a251c6 req-931f7426-5bcf-4a92-b796-a4a6f3e1ab1f service nova] Acquired lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:38:14 user nova-compute[73029]: DEBUG nova.network.neutron [req-fc92aa39-4451-43d1-8540-9ce1c6a251c6 req-931f7426-5bcf-4a92-b796-a4a6f3e1ab1f service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Refreshing network info cache for port 3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:38:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:15 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:38:15 user nova-compute[73029]: DEBUG nova.network.neutron [req-fc92aa39-4451-43d1-8540-9ce1c6a251c6 req-931f7426-5bcf-4a92-b796-a4a6f3e1ab1f service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updated VIF entry in instance network info cache for port 3da49895-08df-44aa-b649-713fc4d4f25e. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:38:15 user nova-compute[73029]: DEBUG nova.network.neutron [req-fc92aa39-4451-43d1-8540-9ce1c6a251c6 req-931f7426-5bcf-4a92-b796-a4a6f3e1ab1f service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updating instance_info_cache with network_info: [{"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:38:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-fc92aa39-4451-43d1-8540-9ce1c6a251c6 req-931f7426-5bcf-4a92-b796-a4a6f3e1ab1f service nova] Releasing lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:38:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:18 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:19 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:38:19 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:38:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8673MB free_disk=24.874542236328125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance db0fae65-f803-4c38-821d-43a05864ee1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance be71c328-6449-4440-8d86-a3f72eb315da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:38:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Skipping network cache update for instance because it is Building. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating instance_info_cache with network_info: [{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:38:20 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Creating image(s)
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Ensure instance console log exists: /opt/stack/data/nova/instances/be71c328-6449-4440-8d86-a3f72eb315da/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Start _get_guest_xml network_info=[{"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '3ec6678b-f520-4c47-9c63-0fb0178dd113', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEMsZkJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be71c328-6449-4440-8d86-a3f72eb315da', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7eb13d8-e332-4ede-9d39-9d603cb50197', 'serial': 'a7eb13d8-e332-4ede-9d39-9d603cb50197'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:38:20 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:38:20 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEMsZkJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:38:20 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:38:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:38:20 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:38:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:38:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:38:20 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:38:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[16707113-6415-4095-946a-50b16d24abc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:38:21 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c9a460-64d8-44d2-bb33-354b8db56425]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197] added
Aug 10 01:38:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c91be4-267d-4c50-a845-c497a92bf77f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e373703d-5786-470f-a92d-ebc14442554b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEMsZkJq {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEMsZkJq" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[26be34d2-a7d2-423b-a4e1-026912e140ce]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TEMsZkJq'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4c8b20-2367-4d66-a278-32c6d1d0b53a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[913a710a-96eb-4574-88a6-c363b1c89c96]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:38:21 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:38:21 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:38:21 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:38:21 user nova-compute[73029]: 
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f90d6cc-028a-435e-a0eb-444b514a4268]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260]
Aug 10 01:38:21 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260] successful.
Aug 10 01:38:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[127f51ad-86ce-44e0-8ea3-c1e46189a548]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a35be6-721a-4baf-b2ec-ac35011f607b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:38:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:38:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a43f4f-3e15-4e52-9927-4dfd2f010694]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEMsZkJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26266336239303336', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266336239303336', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-686929643',display_name='tempest-TestVolumeBootPattern-server-686929643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-686929643',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsN3fyjSXLeCAvLwIFHAU50CtGMLPOymRkuIm3USr6fHM9U54knreLKzrTnyfmMAZntkzxCoQ4pgf2Dl+Es17Bzu9e/k9ShzPAEQSs6hilfL5Bjdq5fcf2C+5KqnZtUA==',key_name='tempest-TestVolumeBootPattern-1218773818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-xapek2dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:38:13Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=be71c328-6449-4440-8d86-a3f72eb315da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:95:7e,bridge_name='br-int',has_traffic_filtering=True,id=3da49895-08df-44aa-b649-713fc4d4f25e,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da49895-08') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.objects.instance [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'pci_devices' on Instance uuid be71c328-6449-4440-8d86-a3f72eb315da {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:38:22 user nova-compute[73029]:   <uuid>be71c328-6449-4440-8d86-a3f72eb315da</uuid>
Aug 10 01:38:22 user nova-compute[73029]:   <name>instance-00000032</name>
Aug 10 01:38:22 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:38:22 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:38:22 user nova-compute[73029]:   <metadata>
Aug 10 01:38:22 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:38:22 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:38:22 user nova-compute[73029]:       <nova:name>tempest-TestVolumeBootPattern-server-686929643</nova:name>
Aug 10 01:38:22 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:38:20</nova:creationTime>
Aug 10 01:38:22 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:38:22 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:38:22 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:38:22 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:38:22 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:38:22 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:38:22 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:38:22 user nova-compute[73029]:       <nova:owner>
Aug 10 01:38:22 user nova-compute[73029]:         <nova:user uuid="44698a7ae911479eb2d5d8a8103ac5dd">tempest-TestVolumeBootPattern-1870123799-project-member</nova:user>
Aug 10 01:38:22 user nova-compute[73029]:         <nova:project uuid="b217381b301d4650bc046a0031d044a7">tempest-TestVolumeBootPattern-1870123799</nova:project>
Aug 10 01:38:22 user nova-compute[73029]:       </nova:owner>
Aug 10 01:38:22 user nova-compute[73029]:       <nova:ports>
Aug 10 01:38:22 user nova-compute[73029]:         <nova:port uuid="3da49895-08df-44aa-b649-713fc4d4f25e">
Aug 10 01:38:22 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 10 01:38:22 user nova-compute[73029]:         </nova:port>
Aug 10 01:38:22 user nova-compute[73029]:       </nova:ports>
Aug 10 01:38:22 user nova-compute[73029]:     </nova:instance>
Aug 10 01:38:22 user nova-compute[73029]:   </metadata>
Aug 10 01:38:22 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:38:22 user nova-compute[73029]:     <system>
Aug 10 01:38:22 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:38:22 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:38:22 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:38:22 user nova-compute[73029]:       <entry name="serial">be71c328-6449-4440-8d86-a3f72eb315da</entry>
Aug 10 01:38:22 user nova-compute[73029]:       <entry name="uuid">be71c328-6449-4440-8d86-a3f72eb315da</entry>
Aug 10 01:38:22 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:38:22 user nova-compute[73029]:     </system>
Aug 10 01:38:22 user nova-compute[73029]:   </sysinfo>
Aug 10 01:38:22 user nova-compute[73029]:   <os>
Aug 10 01:38:22 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:38:22 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:38:22 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:38:22 user nova-compute[73029]:   </os>
Aug 10 01:38:22 user nova-compute[73029]:   <features>
Aug 10 01:38:22 user nova-compute[73029]:     <acpi/>
Aug 10 01:38:22 user nova-compute[73029]:     <apic/>
Aug 10 01:38:22 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:38:22 user nova-compute[73029]:   </features>
Aug 10 01:38:22 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:38:22 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:38:22 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:38:22 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:38:22 user nova-compute[73029]:   </clock>
Aug 10 01:38:22 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:38:22 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:38:22 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:38:22 user nova-compute[73029]:   </cpu>
Aug 10 01:38:22 user nova-compute[73029]:   <devices>
Aug 10 01:38:22 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:38:22 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:38:22 user nova-compute[73029]:       <source dev="/dev/sdb"/>
Aug 10 01:38:22 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:38:22 user nova-compute[73029]:       <serial>a7eb13d8-e332-4ede-9d39-9d603cb50197</serial>
Aug 10 01:38:22 user nova-compute[73029]:     </disk>
Aug 10 01:38:22 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:38:22 user nova-compute[73029]:       <mac address="fa:16:3e:d1:95:7e"/>
Aug 10 01:38:22 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:38:22 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:38:22 user nova-compute[73029]:       <target dev="tap3da49895-08"/>
Aug 10 01:38:22 user nova-compute[73029]:     </interface>
Aug 10 01:38:22 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:38:22 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/be71c328-6449-4440-8d86-a3f72eb315da/console.log" append="off"/>
Aug 10 01:38:22 user nova-compute[73029]:     </serial>
Aug 10 01:38:22 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:38:22 user nova-compute[73029]:     <video>
Aug 10 01:38:22 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:38:22 user nova-compute[73029]:     </video>
Aug 10 01:38:22 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:38:22 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:38:22 user nova-compute[73029]:     </rng>
Aug 10 01:38:22 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:38:22 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:38:22 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:38:22 user nova-compute[73029]:     </memballoon>
Aug 10 01:38:22 user nova-compute[73029]:   </devices>
Aug 10 01:38:22 user nova-compute[73029]: </domain>
Aug 10 01:38:22 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-686929643',display_name='tempest-TestVolumeBootPattern-server-686929643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-686929643',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsN3fyjSXLeCAvLwIFHAU50CtGMLPOymRkuIm3USr6fHM9U54knreLKzrTnyfmMAZntkzxCoQ4pgf2Dl+Es17Bzu9e/k9ShzPAEQSs6hilfL5Bjdq5fcf2C+5KqnZtUA==',key_name='tempest-TestVolumeBootPattern-1218773818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-xapek2dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:38:13Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=be71c328-6449-4440-8d86-a3f72eb315da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:95:7e,bridge_name='br-int',has_traffic_filtering=True,id=3da49895-08df-44aa-b649-713fc4d4f25e,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da49895-08') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG os_vif [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:95:7e,bridge_name='br-int',has_traffic_filtering=True,id=3da49895-08df-44aa-b649-713fc4d4f25e,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da49895-08') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3da49895-08, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3da49895-08, col_values=(('external_ids', {'iface-id': '3da49895-08df-44aa-b649-713fc4d4f25e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:95:7e', 'vm-uuid': 'be71c328-6449-4440-8d86-a3f72eb315da'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:22 user nova-compute[73029]: INFO os_vif [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:95:7e,bridge_name='br-int',has_traffic_filtering=True,id=3da49895-08df-44aa-b649-713fc4d4f25e,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da49895-08')
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No VIF found with MAC fa:16:3e:d1:95:7e, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:38:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-1046a88f-1da2-4ef2-bb90-6b1e32aab922 req-365c0b17-7f3d-4243-a24e-eade700f1fdb service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:38:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1046a88f-1da2-4ef2-bb90-6b1e32aab922 req-365c0b17-7f3d-4243-a24e-eade700f1fdb service nova] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:38:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1046a88f-1da2-4ef2-bb90-6b1e32aab922 req-365c0b17-7f3d-4243-a24e-eade700f1fdb service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:38:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-1046a88f-1da2-4ef2-bb90-6b1e32aab922 req-365c0b17-7f3d-4243-a24e-eade700f1fdb service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:38:23 user nova-compute[73029]: DEBUG nova.compute.manager [req-1046a88f-1da2-4ef2-bb90-6b1e32aab922 req-365c0b17-7f3d-4243-a24e-eade700f1fdb service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] No waiting events found dispatching network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:38:23 user nova-compute[73029]: WARNING nova.compute.manager [req-1046a88f-1da2-4ef2-bb90-6b1e32aab922 req-365c0b17-7f3d-4243-a24e-eade700f1fdb service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received unexpected event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e for instance with vm_state building and task_state spawning.
Aug 10 01:38:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:38:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631505.8197498, be71c328-6449-4440-8d86-a3f72eb315da => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:38:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] VM Resumed (Lifecycle Event)
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:38:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Instance spawned successfully.
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:38:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631505.8231502, be71c328-6449-4440-8d86-a3f72eb315da => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:38:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] VM Started (Lifecycle Event)
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-09eabfe3-1eab-45ff-92d6-099e12f216be req-d4a47068-65de-4b3d-9d66-7ee8b863f5f1 service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-09eabfe3-1eab-45ff-92d6-099e12f216be req-d4a47068-65de-4b3d-9d66-7ee8b863f5f1 service nova] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-09eabfe3-1eab-45ff-92d6-099e12f216be req-d4a47068-65de-4b3d-9d66-7ee8b863f5f1 service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-09eabfe3-1eab-45ff-92d6-099e12f216be req-d4a47068-65de-4b3d-9d66-7ee8b863f5f1 service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.compute.manager [req-09eabfe3-1eab-45ff-92d6-099e12f216be req-d4a47068-65de-4b3d-9d66-7ee8b863f5f1 service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] No waiting events found dispatching network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:38:25 user nova-compute[73029]: WARNING nova.compute.manager [req-09eabfe3-1eab-45ff-92d6-099e12f216be req-d4a47068-65de-4b3d-9d66-7ee8b863f5f1 service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received unexpected event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e for instance with vm_state building and task_state spawning.
Aug 10 01:38:25 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:38:25 user nova-compute[73029]: INFO nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 10 01:38:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:38:26 user nova-compute[73029]: INFO nova.compute.manager [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Took 13.85 seconds to build instance.
Aug 10 01:38:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-95cec893-73db-4a09-a37d-a28c6c02bf53 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "be71c328-6449-4440-8d86-a3f72eb315da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.944s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:38:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:38:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:38:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:38:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:38:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-6fdc6c1a-0fc9-4c54-a157-c5de70a2ca9b req-066d5200-be39-4e92-b63e-e701202e66bd service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received event network-changed-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG nova.compute.manager [req-6fdc6c1a-0fc9-4c54-a157-c5de70a2ca9b req-066d5200-be39-4e92-b63e-e701202e66bd service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Refreshing instance network info cache due to event network-changed-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6fdc6c1a-0fc9-4c54-a157-c5de70a2ca9b req-066d5200-be39-4e92-b63e-e701202e66bd service nova] Acquiring lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6fdc6c1a-0fc9-4c54-a157-c5de70a2ca9b req-066d5200-be39-4e92-b63e-e701202e66bd service nova] Acquired lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG nova.network.neutron [req-6fdc6c1a-0fc9-4c54-a157-c5de70a2ca9b req-066d5200-be39-4e92-b63e-e701202e66bd service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Refreshing network info cache for port 4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG nova.objects.instance [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'flavor' on Instance uuid db0fae65-f803-4c38-821d-43a05864ee1d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG nova.network.neutron [req-6fdc6c1a-0fc9-4c54-a157-c5de70a2ca9b req-066d5200-be39-4e92-b63e-e701202e66bd service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updated VIF entry in instance network info cache for port 4c1e7446-8bc2-4fcf-8d0c-d24542d75d51. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG nova.network.neutron [req-6fdc6c1a-0fc9-4c54-a157-c5de70a2ca9b req-066d5200-be39-4e92-b63e-e701202e66bd service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updating instance_info_cache with network_info: [{"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6fdc6c1a-0fc9-4c54-a157-c5de70a2ca9b req-066d5200-be39-4e92-b63e-e701202e66bd service nova] Releasing lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:38:45 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:38:45 user nova-compute[73029]: INFO nova.compute.manager [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Attaching volume 4a536982-2b3d-4e01-bea1-eef8f37ebb73 to /dev/vdb
Aug 10 01:38:46 user nova-compute[73029]: DEBUG os_brick.utils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b171d4f-babc-460b-99a7-731986bf3b75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f9188b-2a5d-44ca-bc74-5599769629fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f33d1a-f430-4373-895e-ce7d54c55810]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a277855a-e608-455e-b30f-95c0ce544e5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:38:46 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:38:46 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a97579-9f61-4f36-aa1c-d29da851cef3]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG os_brick.utils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:38:46 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updating existing volume attachment record: 374c919a-4253-4184-9ba3-7956e172de6b {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:38:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:38:59 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:38:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ziqbnchv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:38:59 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:38:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:38:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:38:59 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:38:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:38:59 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:38:59 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:38:59 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fdaa59-d4c1-400e-ad92-92cb0ddd0791]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:39:00 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed3c8a4-101a-40a9-864d-d467b5a88ac2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73] added
Aug 10 01:39:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e145503c-6a87-45c0-8e9e-50cb4367e80f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda2b51f-c83c-4828-990e-2c38aa3f9c39]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ziqbnchv {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ziqbnchv" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d970d9-5755-4abc-94cc-52d0a47fb217]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Ziqbnchv'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a87957-3299-4f0d-862b-07251e184511]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c227502-e310-4c15-9a35-0614ca37603e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:39:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:39:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a78aafe-0e39-4564-8faf-5bb0ad704db7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73, portal: 172.16.0.220,3260]
Aug 10 01:39:00 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73, portal: 172.16.0.220,3260] successful.
Aug 10 01:39:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[feabe016-35b6-4475-962b-8cf07748a9a6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b620371-a2d6-4280-9b9c-3164eac61e8e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:39:00 user nova-compute[73029]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 (non-flash)
Aug 10 01:39:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:39:00 user nova-compute[73029]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 (non-flash)
Aug 10 01:39:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41015e7-f22a-4a44-9c11-b20ad831bd70]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ziqbnchv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23434316561333566', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434316561333566', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG nova.objects.instance [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'flavor' on Instance uuid db0fae65-f803-4c38-821d-43a05864ee1d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:39:01 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:39:01 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 01:39:01 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:39:01 user nova-compute[73029]:   <serial>4a536982-2b3d-4e01-bea1-eef8f37ebb73</serial>
Aug 10 01:39:01 user nova-compute[73029]: </disk>
Aug 10 01:39:01 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] No VIF found with MAC fa:16:3e:3d:27:de, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:39:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-250f0bb9-2929-48cb-b04b-c98005a3a00d tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.888s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:39:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:39:03 user nova-compute[73029]: INFO nova.compute.manager [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Detaching volume 4a536982-2b3d-4e01-bea1-eef8f37ebb73
Aug 10 01:39:03 user nova-compute[73029]: INFO nova.virt.block_device [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Attempting to driver detach volume 4a536982-2b3d-4e01-bea1-eef8f37ebb73 from mountpoint /dev/vdb
Aug 10 01:39:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Attempting to detach device vdb from instance db0fae65-f803-4c38-821d-43a05864ee1d from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:39:03 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:39:03 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 01:39:03 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:39:03 user nova-compute[73029]:   <serial>4a536982-2b3d-4e01-bea1-eef8f37ebb73</serial>
Aug 10 01:39:03 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:39:03 user nova-compute[73029]: </disk>
Aug 10 01:39:03 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:39:03 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Successfully detached device vdb from instance db0fae65-f803-4c38-821d-43a05864ee1d from the persistent domain config.
Aug 10 01:39:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db0fae65-f803-4c38-821d-43a05864ee1d from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:39:03 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:39:03 user nova-compute[73029]:   <source dev="/dev/sdc"/>
Aug 10 01:39:03 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:39:03 user nova-compute[73029]:   <serial>4a536982-2b3d-4e01-bea1-eef8f37ebb73</serial>
Aug 10 01:39:03 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:39:03 user nova-compute[73029]: </disk>
Aug 10 01:39:03 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691631543.83762, db0fae65-f803-4c38-821d-43a05864ee1d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db0fae65-f803-4c38-821d-43a05864ee1d {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:39:03 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Successfully detached device vdb from instance db0fae65-f803-4c38-821d-43a05864ee1d from the live domain config.
Aug 10 01:39:03 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ziqbnchv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:39:03 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce1b2dc-a8ec-4c68-bc4b-783039cca58e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3578a023-a5f2-4d7e-b212-73dbe04b0a72]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:39:03 user nova-compute[73029]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 (non-flash)
Aug 10 01:39:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:39:03 user nova-compute[73029]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 (non-flash)
Aug 10 01:39:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f0527be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a34fb8d-f0bf-4a82-96ab-53d6c1f8f349]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc63b1f6-a228-496d-87fa-0f591c29c288]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02946d6-b8a8-439c-9583-7dcc7ad7c8c6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f8dae-f81f-45e1-8f63-e24beea04184]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[113db6f9-2a23-4632-92dd-a6d5c4675624]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3387b3b-fad7-4b71-80c2-838ac7ff1756]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73, portal: 172.16.0.220,3260]
Aug 10 01:39:04 user nova-compute[73029]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73, portal: 172.16.0.220,3260] successful.
Aug 10 01:39:04 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a536982-2b3d-4e01-bea1-eef8f37ebb73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c21195-45c9-41c7-ad50-c3e7f2a5b9b2]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] <== disconnect_volume: return (255ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG nova.objects.instance [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'flavor' on Instance uuid db0fae65-f803-4c38-821d-43a05864ee1d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:39:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-57d5edd5-8a29-4121-9d24-a04af3fce2b0 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.543s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:39:05 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:39:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:10 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:39:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:39:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:39:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:39:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:39:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:15 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:39:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:39:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:39:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:39:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:39:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:39:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updating instance_info_cache with network_info: [{"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:39:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:39:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:39:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=24.872608184814453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance db0fae65-f803-4c38-821d-43a05864ee1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance be71c328-6449-4440-8d86-a3f72eb315da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:39:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:39:22 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:39:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:39:22 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:39:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:39:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:39:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:39:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:39:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:39:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:39:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:39:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:39:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-d2e8894d-8265-444a-887d-50f087e955cb req-274e9557-a4ef-4b85-ae6d-edff53b4c955 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received event network-changed-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-d2e8894d-8265-444a-887d-50f087e955cb req-274e9557-a4ef-4b85-ae6d-edff53b4c955 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Refreshing instance network info cache due to event network-changed-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d2e8894d-8265-444a-887d-50f087e955cb req-274e9557-a4ef-4b85-ae6d-edff53b4c955 service nova] Acquiring lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d2e8894d-8265-444a-887d-50f087e955cb req-274e9557-a4ef-4b85-ae6d-edff53b4c955 service nova] Acquired lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-d2e8894d-8265-444a-887d-50f087e955cb req-274e9557-a4ef-4b85-ae6d-edff53b4c955 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Refreshing network info cache for port 4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:39:54 user nova-compute[73029]: INFO nova.compute.manager [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Terminating instance
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-e3a28059-1466-4226-8f53-4f936a774014 req-176bd479-bc97-45c8-9043-39d89ae258ec service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received event network-vif-unplugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e3a28059-1466-4226-8f53-4f936a774014 req-176bd479-bc97-45c8-9043-39d89ae258ec service nova] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e3a28059-1466-4226-8f53-4f936a774014 req-176bd479-bc97-45c8-9043-39d89ae258ec service nova] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-e3a28059-1466-4226-8f53-4f936a774014 req-176bd479-bc97-45c8-9043-39d89ae258ec service nova] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-e3a28059-1466-4226-8f53-4f936a774014 req-176bd479-bc97-45c8-9043-39d89ae258ec service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] No waiting events found dispatching network-vif-unplugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.compute.manager [req-e3a28059-1466-4226-8f53-4f936a774014 req-176bd479-bc97-45c8-9043-39d89ae258ec service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received event network-vif-unplugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-d2e8894d-8265-444a-887d-50f087e955cb req-274e9557-a4ef-4b85-ae6d-edff53b4c955 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updated VIF entry in instance network info cache for port 4c1e7446-8bc2-4fcf-8d0c-d24542d75d51. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.network.neutron [req-d2e8894d-8265-444a-887d-50f087e955cb req-274e9557-a4ef-4b85-ae6d-edff53b4c955 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updating instance_info_cache with network_info: [{"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-d2e8894d-8265-444a-887d-50f087e955cb req-274e9557-a4ef-4b85-ae6d-edff53b4c955 service nova] Releasing lock "refresh_cache-db0fae65-f803-4c38-821d-43a05864ee1d" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:39:54 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Instance destroyed successfully.
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.objects.instance [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'resources' on Instance uuid db0fae65-f803-4c38-821d-43a05864ee1d {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1797206433',display_name='tempest-TestStampPattern-server-1797206433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1797206433',id=49,image_ref='72f9901b-3fdf-4473-8e4b-322e34a9f18b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAddBkpSKohxYOXkI3rImgDqSstvP3ZRXcIf/qUsLQoP0yH4xe/0HVF+nDjSxI3MoMcBmnNa4AjB+RjR3Qrtfpqu5nAJJmTCSg0WHfY3z/SYwdN1kQs2MBTqdEgrMr0vg==',key_name='tempest-TestStampPattern-2134481350',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:37:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9215a23c39a8459189ebc450d8e8c04a',ramdisk_id='',reservation_id='r-r1gzbz3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7',image_min_disk='1',image_min_ram='0',image_owner_id='9215a23c39a8459189ebc450d8e8c04a',image_owner_project_name='tempest-TestStampPattern-174573223',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-174573223-project-member',image_user_id='78c0f17ce2de4d6e9157b86db5d1a59e',owner_project_name='tempest-TestStampPattern-174573223',owner_user_name='tempest-TestStampPattern-174573223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:37:01Z,user_data=None,user_id='78c0f17ce2de4d6e9157b86db5d1a59e',uuid=db0fae65-f803-4c38-821d-43a05864ee1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converting VIF {"id": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "address": "fa:16:3e:3d:27:de", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e7446-8b", "ovs_interfaceid": "4c1e7446-8bc2-4fcf-8d0c-d24542d75d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:27:de,bridge_name='br-int',has_traffic_filtering=True,id=4c1e7446-8bc2-4fcf-8d0c-d24542d75d51,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e7446-8b') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG os_vif [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:27:de,bridge_name='br-int',has_traffic_filtering=True,id=4c1e7446-8bc2-4fcf-8d0c-d24542d75d51,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e7446-8b') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c1e7446-8b, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:39:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:39:54 user nova-compute[73029]: INFO os_vif [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:27:de,bridge_name='br-int',has_traffic_filtering=True,id=4c1e7446-8bc2-4fcf-8d0c-d24542d75d51,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e7446-8b')
Aug 10 01:39:54 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Deleting instance files /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d_del
Aug 10 01:39:54 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Deletion of /opt/stack/data/nova/instances/db0fae65-f803-4c38-821d-43a05864ee1d_del complete
Aug 10 01:39:55 user nova-compute[73029]: INFO nova.compute.manager [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 10 01:39:55 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:39:55 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:39:55 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:39:55 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:39:55 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Took 0.47 seconds to deallocate network for instance.
Aug 10 01:39:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:39:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:39:55 user nova-compute[73029]: DEBUG nova.compute.manager [req-7313266d-2950-40a5-b314-cf7f10a5eba8 req-0ded5586-9e23-4a3f-aeda-949d88342754 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received event network-vif-deleted-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:39:55 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:39:55 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:39:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:39:55 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Deleted allocations for instance db0fae65-f803-4c38-821d-43a05864ee1d
Aug 10 01:39:55 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-05968526-d010-4a7f-9ae9-59bdab89be62 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "db0fae65-f803-4c38-821d-43a05864ee1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.650s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:39:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-6305ed68-b5f0-4136-9cec-5ba27a85a7d4 req-b854dcbf-17c9-426c-ab75-cc665809b3f2 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received event network-vif-plugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:39:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6305ed68-b5f0-4136-9cec-5ba27a85a7d4 req-b854dcbf-17c9-426c-ab75-cc665809b3f2 service nova] Acquiring lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:39:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6305ed68-b5f0-4136-9cec-5ba27a85a7d4 req-b854dcbf-17c9-426c-ab75-cc665809b3f2 service nova] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:39:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6305ed68-b5f0-4136-9cec-5ba27a85a7d4 req-b854dcbf-17c9-426c-ab75-cc665809b3f2 service nova] Lock "db0fae65-f803-4c38-821d-43a05864ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:39:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-6305ed68-b5f0-4136-9cec-5ba27a85a7d4 req-b854dcbf-17c9-426c-ab75-cc665809b3f2 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] No waiting events found dispatching network-vif-plugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:39:56 user nova-compute[73029]: WARNING nova.compute.manager [req-6305ed68-b5f0-4136-9cec-5ba27a85a7d4 req-b854dcbf-17c9-426c-ab75-cc665809b3f2 service nova] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Received unexpected event network-vif-plugged-4c1e7446-8bc2-4fcf-8d0c-d24542d75d51 for instance with vm_state deleted and task_state None.
Aug 10 01:39:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:04 user nova-compute[73029]: DEBUG nova.compute.manager [req-6ae5a413-ca85-4511-8e94-ba20ed5e77eb req-61990a53-1a89-475e-8a34-dc72017df1f7 service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-changed-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:40:04 user nova-compute[73029]: DEBUG nova.compute.manager [req-6ae5a413-ca85-4511-8e94-ba20ed5e77eb req-61990a53-1a89-475e-8a34-dc72017df1f7 service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Refreshing instance network info cache due to event network-changed-3da49895-08df-44aa-b649-713fc4d4f25e. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6ae5a413-ca85-4511-8e94-ba20ed5e77eb req-61990a53-1a89-475e-8a34-dc72017df1f7 service nova] Acquiring lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6ae5a413-ca85-4511-8e94-ba20ed5e77eb req-61990a53-1a89-475e-8a34-dc72017df1f7 service nova] Acquired lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:40:04 user nova-compute[73029]: DEBUG nova.network.neutron [req-6ae5a413-ca85-4511-8e94-ba20ed5e77eb req-61990a53-1a89-475e-8a34-dc72017df1f7 service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Refreshing network info cache for port 3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:40:04 user nova-compute[73029]: DEBUG nova.network.neutron [req-6ae5a413-ca85-4511-8e94-ba20ed5e77eb req-61990a53-1a89-475e-8a34-dc72017df1f7 service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updated VIF entry in instance network info cache for port 3da49895-08df-44aa-b649-713fc4d4f25e. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:40:04 user nova-compute[73029]: DEBUG nova.network.neutron [req-6ae5a413-ca85-4511-8e94-ba20ed5e77eb req-61990a53-1a89-475e-8a34-dc72017df1f7 service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updating instance_info_cache with network_info: [{"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:40:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6ae5a413-ca85-4511-8e94-ba20ed5e77eb req-61990a53-1a89-475e-8a34-dc72017df1f7 service nova] Releasing lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:40:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:09 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691631594.944388, db0fae65-f803-4c38-821d-43a05864ee1d => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:40:09 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] VM Stopped (Lifecycle Event)
Aug 10 01:40:09 user nova-compute[73029]: DEBUG nova.compute.manager [None req-98cc58dc-197f-473e-a639-13281c002d79 None None] [instance: db0fae65-f803-4c38-821d-43a05864ee1d] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:40:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:16 user nova-compute[73029]: DEBUG nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:40:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:16 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:16 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:40:16 user nova-compute[73029]: INFO nova.compute.claims [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Claim successful on node user
Aug 10 01:40:16 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:40:16 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:40:17 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:40:17 user nova-compute[73029]: DEBUG nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:40:17 user nova-compute[73029]: INFO nova.virt.block_device [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Booting with volume 4f30d402-94be-4571-86db-f5ba60e6af27 at /dev/vda
Aug 10 01:40:17 user nova-compute[73029]: DEBUG nova.policy [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44698a7ae911479eb2d5d8a8103ac5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b217381b301d4650bc046a0031d044a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG os_brick.utils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[693fa35a-e73e-4ccd-9a78-cecc44398d0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[318b8262-f0c4-44dc-ba45-4169e50ce1ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fe64a1-b1d3-4938-b6a6-bf388fa14ac3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[185c7492-4075-43f3-9c80-ef3a24717537]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:40:17 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:40:17 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a00b00-6815-4d17-96a8-4ca32907061a]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG os_brick.utils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Updating existing volume attachment record: efb9360b-96a9-4506-84f1-973ffa793561 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:40:17 user nova-compute[73029]: DEBUG nova.network.neutron [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Successfully created port: 2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:40:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Successfully updated port: 2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquired lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:40:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:40:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-28faf1e8-6e4c-4482-962b-ac64f692009f req-481890c4-6210-476a-abcf-2e1849b9c1d7 service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received event network-changed-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:40:18 user nova-compute[73029]: DEBUG nova.compute.manager [req-28faf1e8-6e4c-4482-962b-ac64f692009f req-481890c4-6210-476a-abcf-2e1849b9c1d7 service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Refreshing instance network info cache due to event network-changed-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:40:18 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-28faf1e8-6e4c-4482-962b-ac64f692009f req-481890c4-6210-476a-abcf-2e1849b9c1d7 service nova] Acquiring lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:40:18 user nova-compute[73029]: DEBUG nova.network.neutron [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG nova.network.neutron [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Updating instance_info_cache with network_info: [{"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Releasing lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Instance network_info: |[{"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-28faf1e8-6e4c-4482-962b-ac64f692009f req-481890c4-6210-476a-abcf-2e1849b9c1d7 service nova] Acquired lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-28faf1e8-6e4c-4482-962b-ac64f692009f req-481890c4-6210-476a-abcf-2e1849b9c1d7 service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Refreshing network info cache for port 2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-28faf1e8-6e4c-4482-962b-ac64f692009f req-481890c4-6210-476a-abcf-2e1849b9c1d7 service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Updated VIF entry in instance network info cache for port 2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG nova.network.neutron [req-28faf1e8-6e4c-4482-962b-ac64f692009f req-481890c4-6210-476a-abcf-2e1849b9c1d7 service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Updating instance_info_cache with network_info: [{"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-28faf1e8-6e4c-4482-962b-ac64f692009f req-481890c4-6210-476a-abcf-2e1849b9c1d7 service nova] Releasing lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:40:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:40:20 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:40:20 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:40:20 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8601MB free_disk=24.872615814208984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance be71c328-6449-4440-8d86-a3f72eb315da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:40:20 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:40:21 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:40:21 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:40:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:40:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Skipping network cache update for instance because it is Building. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:40:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating instance_info_cache with network_info: [{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:40:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:40:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:40:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:40:25 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Creating image(s)
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Did not create local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Ensure instance console log exists: /opt/stack/data/nova/instances/f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Start _get_guest_xml network_info=[{"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'efb9360b-96a9-4506-84f1-973ffa793561', 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZcFvRnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f', 'attached_at': '', 'detached_at': '', 'volume_id': '4f30d402-94be-4571-86db-f5ba60e6af27', 'serial': '4f30d402-94be-4571-86db-f5ba60e6af27'}, 'volume_type': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:40:25 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:40:25 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZcFvRnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:40:25 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:40:25 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:40:25 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5ac281-d0d2-4049-911a-c8c51185c7c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:40:25 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c0d401-c74b-4881-9719-2403813e90c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27] added
Aug 10 01:40:25 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a16910f-9e76-4c79-821b-20ac48f86c0b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1e022b-b56f-4110-891b-192fdde27ad5]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZcFvRnJ {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZcFvRnJ" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dbe147-3fec-4d14-b84f-43f648f3480b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zZcFvRnJ'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:40:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c00c5b3-6448-483c-b59c-b3dfefd74c43]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2370057-c20c-4db3-8ae5-9c87324e66f6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:40:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:40:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfbeeff-38e4-4e3b-974e-e24baecf07cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27, portal: 172.16.0.220,3260]
Aug 10 01:40:26 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27, portal: 172.16.0.220,3260] successful.
Aug 10 01:40:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a85a686-e79b-43a2-be22-81113cd5776d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[764670c0-5534-4075-8a66-a320cdacd2aa]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:40:26 user nova-compute[73029]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 (non-flash)
Aug 10 01:40:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:40:26 user nova-compute[73029]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 (non-flash)
Aug 10 01:40:26 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a03ecf-6c24-46a6-a315-af310fea0e47]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:40:26 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZcFvRnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26536336239653932', 'path': '/dev/sdc'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536336239653932', 'path': '/dev/sdc'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1305997313',display_name='tempest-TestVolumeBootPattern-server-1305997313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1305997313',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsN3fyjSXLeCAvLwIFHAU50CtGMLPOymRkuIm3USr6fHM9U54knreLKzrTnyfmMAZntkzxCoQ4pgf2Dl+Es17Bzu9e/k9ShzPAEQSs6hilfL5Bjdq5fcf2C+5KqnZtUA==',key_name='tempest-TestVolumeBootPattern-1218773818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-6hrxbiia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:40:17Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:40:c2,bridge_name='br-int',has_traffic_filtering=True,id=2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dacd6a2-f1') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.objects.instance [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'pci_devices' on Instance uuid f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:40:27 user nova-compute[73029]:   <uuid>f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f</uuid>
Aug 10 01:40:27 user nova-compute[73029]:   <name>instance-00000033</name>
Aug 10 01:40:27 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:40:27 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:40:27 user nova-compute[73029]:   <metadata>
Aug 10 01:40:27 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:40:27 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:40:27 user nova-compute[73029]:       <nova:name>tempest-TestVolumeBootPattern-server-1305997313</nova:name>
Aug 10 01:40:27 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:40:25</nova:creationTime>
Aug 10 01:40:27 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:40:27 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:40:27 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:40:27 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:40:27 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:40:27 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:40:27 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:40:27 user nova-compute[73029]:       <nova:owner>
Aug 10 01:40:27 user nova-compute[73029]:         <nova:user uuid="44698a7ae911479eb2d5d8a8103ac5dd">tempest-TestVolumeBootPattern-1870123799-project-member</nova:user>
Aug 10 01:40:27 user nova-compute[73029]:         <nova:project uuid="b217381b301d4650bc046a0031d044a7">tempest-TestVolumeBootPattern-1870123799</nova:project>
Aug 10 01:40:27 user nova-compute[73029]:       </nova:owner>
Aug 10 01:40:27 user nova-compute[73029]:       <nova:ports>
Aug 10 01:40:27 user nova-compute[73029]:         <nova:port uuid="2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482">
Aug 10 01:40:27 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 10 01:40:27 user nova-compute[73029]:         </nova:port>
Aug 10 01:40:27 user nova-compute[73029]:       </nova:ports>
Aug 10 01:40:27 user nova-compute[73029]:     </nova:instance>
Aug 10 01:40:27 user nova-compute[73029]:   </metadata>
Aug 10 01:40:27 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:40:27 user nova-compute[73029]:     <system>
Aug 10 01:40:27 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:40:27 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:40:27 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:40:27 user nova-compute[73029]:       <entry name="serial">f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f</entry>
Aug 10 01:40:27 user nova-compute[73029]:       <entry name="uuid">f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f</entry>
Aug 10 01:40:27 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:40:27 user nova-compute[73029]:     </system>
Aug 10 01:40:27 user nova-compute[73029]:   </sysinfo>
Aug 10 01:40:27 user nova-compute[73029]:   <os>
Aug 10 01:40:27 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:40:27 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:40:27 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:40:27 user nova-compute[73029]:   </os>
Aug 10 01:40:27 user nova-compute[73029]:   <features>
Aug 10 01:40:27 user nova-compute[73029]:     <acpi/>
Aug 10 01:40:27 user nova-compute[73029]:     <apic/>
Aug 10 01:40:27 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:40:27 user nova-compute[73029]:   </features>
Aug 10 01:40:27 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:40:27 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:40:27 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:40:27 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:40:27 user nova-compute[73029]:   </clock>
Aug 10 01:40:27 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:40:27 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:40:27 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:40:27 user nova-compute[73029]:   </cpu>
Aug 10 01:40:27 user nova-compute[73029]:   <devices>
Aug 10 01:40:27 user nova-compute[73029]:     <disk type="block" device="disk">
Aug 10 01:40:27 user nova-compute[73029]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:40:27 user nova-compute[73029]:       <source dev="/dev/sdc"/>
Aug 10 01:40:27 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:40:27 user nova-compute[73029]:       <serial>4f30d402-94be-4571-86db-f5ba60e6af27</serial>
Aug 10 01:40:27 user nova-compute[73029]:     </disk>
Aug 10 01:40:27 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:40:27 user nova-compute[73029]:       <mac address="fa:16:3e:22:40:c2"/>
Aug 10 01:40:27 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:40:27 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:40:27 user nova-compute[73029]:       <target dev="tap2dacd6a2-f1"/>
Aug 10 01:40:27 user nova-compute[73029]:     </interface>
Aug 10 01:40:27 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:40:27 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f/console.log" append="off"/>
Aug 10 01:40:27 user nova-compute[73029]:     </serial>
Aug 10 01:40:27 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:40:27 user nova-compute[73029]:     <video>
Aug 10 01:40:27 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:40:27 user nova-compute[73029]:     </video>
Aug 10 01:40:27 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:40:27 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:40:27 user nova-compute[73029]:     </rng>
Aug 10 01:40:27 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:40:27 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:40:27 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:40:27 user nova-compute[73029]:     </memballoon>
Aug 10 01:40:27 user nova-compute[73029]:   </devices>
Aug 10 01:40:27 user nova-compute[73029]: </domain>
Aug 10 01:40:27 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1305997313',display_name='tempest-TestVolumeBootPattern-server-1305997313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1305997313',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsN3fyjSXLeCAvLwIFHAU50CtGMLPOymRkuIm3USr6fHM9U54knreLKzrTnyfmMAZntkzxCoQ4pgf2Dl+Es17Bzu9e/k9ShzPAEQSs6hilfL5Bjdq5fcf2C+5KqnZtUA==',key_name='tempest-TestVolumeBootPattern-1218773818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-6hrxbiia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:40:17Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:40:c2,bridge_name='br-int',has_traffic_filtering=True,id=2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dacd6a2-f1') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG os_vif [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:40:c2,bridge_name='br-int',has_traffic_filtering=True,id=2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dacd6a2-f1') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dacd6a2-f1, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dacd6a2-f1, col_values=(('external_ids', {'iface-id': '2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:40:c2', 'vm-uuid': 'f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:27 user nova-compute[73029]: INFO os_vif [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:40:c2,bridge_name='br-int',has_traffic_filtering=True,id=2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dacd6a2-f1')
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:40:27 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] No VIF found with MAC fa:16:3e:22:40:c2, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:40:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-58cf18be-eb37-4791-b7d3-65aec1ea29eb req-24a1ec20-cc71-4c12-b7fc-3cd22b104d8c service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received event network-vif-plugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:40:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-58cf18be-eb37-4791-b7d3-65aec1ea29eb req-24a1ec20-cc71-4c12-b7fc-3cd22b104d8c service nova] Acquiring lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-58cf18be-eb37-4791-b7d3-65aec1ea29eb req-24a1ec20-cc71-4c12-b7fc-3cd22b104d8c service nova] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-58cf18be-eb37-4791-b7d3-65aec1ea29eb req-24a1ec20-cc71-4c12-b7fc-3cd22b104d8c service nova] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:28 user nova-compute[73029]: DEBUG nova.compute.manager [req-58cf18be-eb37-4791-b7d3-65aec1ea29eb req-24a1ec20-cc71-4c12-b7fc-3cd22b104d8c service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] No waiting events found dispatching network-vif-plugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:40:28 user nova-compute[73029]: WARNING nova.compute.manager [req-58cf18be-eb37-4791-b7d3-65aec1ea29eb req-24a1ec20-cc71-4c12-b7fc-3cd22b104d8c service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received unexpected event network-vif-plugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 for instance with vm_state building and task_state spawning.
Aug 10 01:40:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631630.6378233, f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:40:30 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] VM Resumed (Lifecycle Event)
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:40:30 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Instance spawned successfully.
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:40:30 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631630.6392548, f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:40:30 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] VM Started (Lifecycle Event)
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:40:30 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:40:30 user nova-compute[73029]: INFO nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:40:30 user nova-compute[73029]: INFO nova.compute.manager [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Took 14.09 seconds to build instance.
Aug 10 01:40:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-10dba028-2e65-4876-8ba1-759291490124 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.187s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-8c38553b-b561-46fb-926e-bfaf11f92486 req-36bce8b4-16c8-4b7f-9de3-ac57ed563b62 service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received event network-vif-plugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8c38553b-b561-46fb-926e-bfaf11f92486 req-36bce8b4-16c8-4b7f-9de3-ac57ed563b62 service nova] Acquiring lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8c38553b-b561-46fb-926e-bfaf11f92486 req-36bce8b4-16c8-4b7f-9de3-ac57ed563b62 service nova] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8c38553b-b561-46fb-926e-bfaf11f92486 req-36bce8b4-16c8-4b7f-9de3-ac57ed563b62 service nova] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:30 user nova-compute[73029]: DEBUG nova.compute.manager [req-8c38553b-b561-46fb-926e-bfaf11f92486 req-36bce8b4-16c8-4b7f-9de3-ac57ed563b62 service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] No waiting events found dispatching network-vif-plugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:40:30 user nova-compute[73029]: WARNING nova.compute.manager [req-8c38553b-b561-46fb-926e-bfaf11f92486 req-36bce8b4-16c8-4b7f-9de3-ac57ed563b62 service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received unexpected event network-vif-plugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 for instance with vm_state active and task_state None.
Aug 10 01:40:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:33 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-6623d8d4-1708-412d-aaee-c459a4524519 req-523812ec-1d29-4025-b8a4-fcc7f46fd26d service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received event network-changed-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-6623d8d4-1708-412d-aaee-c459a4524519 req-523812ec-1d29-4025-b8a4-fcc7f46fd26d service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Refreshing instance network info cache due to event network-changed-de6c581c-f84d-4519-9cd7-7f81b40870dc. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6623d8d4-1708-412d-aaee-c459a4524519 req-523812ec-1d29-4025-b8a4-fcc7f46fd26d service nova] Acquiring lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6623d8d4-1708-412d-aaee-c459a4524519 req-523812ec-1d29-4025-b8a4-fcc7f46fd26d service nova] Acquired lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG nova.network.neutron [req-6623d8d4-1708-412d-aaee-c459a4524519 req-523812ec-1d29-4025-b8a4-fcc7f46fd26d service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Refreshing network info cache for port de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:56 user nova-compute[73029]: INFO nova.compute.manager [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Terminating instance
Aug 10 01:40:56 user nova-compute[73029]: DEBUG nova.compute.manager [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-ffaba029-bf0d-4e83-8efb-ae29649ad522 req-6301043c-9e8b-48d7-8b15-b9b03a34eb10 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received event network-vif-unplugged-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ffaba029-bf0d-4e83-8efb-ae29649ad522 req-6301043c-9e8b-48d7-8b15-b9b03a34eb10 service nova] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ffaba029-bf0d-4e83-8efb-ae29649ad522 req-6301043c-9e8b-48d7-8b15-b9b03a34eb10 service nova] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ffaba029-bf0d-4e83-8efb-ae29649ad522 req-6301043c-9e8b-48d7-8b15-b9b03a34eb10 service nova] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-ffaba029-bf0d-4e83-8efb-ae29649ad522 req-6301043c-9e8b-48d7-8b15-b9b03a34eb10 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] No waiting events found dispatching network-vif-unplugged-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG nova.compute.manager [req-ffaba029-bf0d-4e83-8efb-ae29649ad522 req-6301043c-9e8b-48d7-8b15-b9b03a34eb10 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received event network-vif-unplugged-de6c581c-f84d-4519-9cd7-7f81b40870dc for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG nova.network.neutron [req-6623d8d4-1708-412d-aaee-c459a4524519 req-523812ec-1d29-4025-b8a4-fcc7f46fd26d service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updated VIF entry in instance network info cache for port de6c581c-f84d-4519-9cd7-7f81b40870dc. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG nova.network.neutron [req-6623d8d4-1708-412d-aaee-c459a4524519 req-523812ec-1d29-4025-b8a4-fcc7f46fd26d service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating instance_info_cache with network_info: [{"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:40:56 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6623d8d4-1708-412d-aaee-c459a4524519 req-523812ec-1d29-4025-b8a4-fcc7f46fd26d service nova] Releasing lock "refresh_cache-a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:40:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Instance destroyed successfully.
Aug 10 01:40:57 user nova-compute[73029]: DEBUG nova.objects.instance [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lazy-loading 'resources' on Instance uuid a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-212852808',display_name='tempest-TestStampPattern-server-212852808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-212852808',id=47,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAddBkpSKohxYOXkI3rImgDqSstvP3ZRXcIf/qUsLQoP0yH4xe/0HVF+nDjSxI3MoMcBmnNa4AjB+RjR3Qrtfpqu5nAJJmTCSg0WHfY3z/SYwdN1kQs2MBTqdEgrMr0vg==',key_name='tempest-TestStampPattern-2134481350',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9215a23c39a8459189ebc450d8e8c04a',ramdisk_id='',reservation_id='r-ihta25sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-174573223',owner_user_name='tempest-TestStampPattern-174573223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:36:51Z,user_data=None,user_id='78c0f17ce2de4d6e9157b86db5d1a59e',uuid=a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converting VIF {"id": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "address": "fa:16:3e:86:d6:db", "network": {"id": "e6b5a010-d5f5-41d2-93fa-3802fa3125a1", "bridge": "br-int", "label": "tempest-TestStampPattern-337518979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9215a23c39a8459189ebc450d8e8c04a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde6c581c-f8", "ovs_interfaceid": "de6c581c-f84d-4519-9cd7-7f81b40870dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:d6:db,bridge_name='br-int',has_traffic_filtering=True,id=de6c581c-f84d-4519-9cd7-7f81b40870dc,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde6c581c-f8') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG os_vif [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:d6:db,bridge_name='br-int',has_traffic_filtering=True,id=de6c581c-f84d-4519-9cd7-7f81b40870dc,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde6c581c-f8') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde6c581c-f8, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:40:57 user nova-compute[73029]: INFO os_vif [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:d6:db,bridge_name='br-int',has_traffic_filtering=True,id=de6c581c-f84d-4519-9cd7-7f81b40870dc,network=Network(e6b5a010-d5f5-41d2-93fa-3802fa3125a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde6c581c-f8')
Aug 10 01:40:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Deleting instance files /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7_del
Aug 10 01:40:57 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Deletion of /opt/stack/data/nova/instances/a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7_del complete
Aug 10 01:40:57 user nova-compute[73029]: INFO nova.compute.manager [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 10 01:40:57 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:40:57 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:40:57 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Took 0.74 seconds to deallocate network for instance.
Aug 10 01:40:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:58 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Deleted allocations for instance a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7
Aug 10 01:40:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-235d18ad-77a7-494d-b291-8a03cef60713 tempest-TestStampPattern-174573223 tempest-TestStampPattern-174573223-project-member] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.918s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-c6e7533c-7ba9-43d9-afcf-75301e635d64 req-98ccf34c-1339-42bf-b474-f0e127c594f2 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received event network-vif-deleted-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-ebd56192-a9d6-4741-acf6-35ab6f7d8d69 req-57cdab36-e7c5-4eac-85e7-7d002cd8c4d7 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received event network-vif-plugged-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ebd56192-a9d6-4741-acf6-35ab6f7d8d69 req-57cdab36-e7c5-4eac-85e7-7d002cd8c4d7 service nova] Acquiring lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ebd56192-a9d6-4741-acf6-35ab6f7d8d69 req-57cdab36-e7c5-4eac-85e7-7d002cd8c4d7 service nova] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-ebd56192-a9d6-4741-acf6-35ab6f7d8d69 req-57cdab36-e7c5-4eac-85e7-7d002cd8c4d7 service nova] Lock "a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:40:58 user nova-compute[73029]: DEBUG nova.compute.manager [req-ebd56192-a9d6-4741-acf6-35ab6f7d8d69 req-57cdab36-e7c5-4eac-85e7-7d002cd8c4d7 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] No waiting events found dispatching network-vif-plugged-de6c581c-f84d-4519-9cd7-7f81b40870dc {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:40:58 user nova-compute[73029]: WARNING nova.compute.manager [req-ebd56192-a9d6-4741-acf6-35ab6f7d8d69 req-57cdab36-e7c5-4eac-85e7-7d002cd8c4d7 service nova] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Received unexpected event network-vif-plugged-de6c581c-f84d-4519-9cd7-7f81b40870dc for instance with vm_state deleted and task_state None.
Aug 10 01:41:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:41:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:41:08 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:41:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:41:12 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691631657.1287134, a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:41:12 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] VM Stopped (Lifecycle Event)
Aug 10 01:41:12 user nova-compute[73029]: DEBUG nova.compute.manager [None req-34851dab-6110-4f8c-9777-3d67805825a6 None None] [instance: a6cb4780-205e-4a60-ad62-8e8b5ef5a1a7] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:41:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:41:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:41:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:41:18 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:41:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:41:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:41:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:41:21 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8661MB free_disk=24.99640655517578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance be71c328-6449-4440-8d86-a3f72eb315da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:41:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:41:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:41:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:41:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:41:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:41:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:41:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updating instance_info_cache with network_info: [{"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:41:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:41:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:41:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:41:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:41:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:41:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:41:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:41:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:41:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:41:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:41:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:41:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:42:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-2efccfd9-1ed2-4ef9-9941-cec2773898fb req-c5cedd90-6b48-4fff-bf96-f66a5055fc0b service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received event network-changed-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:42:08 user nova-compute[73029]: DEBUG nova.compute.manager [req-2efccfd9-1ed2-4ef9-9941-cec2773898fb req-c5cedd90-6b48-4fff-bf96-f66a5055fc0b service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Refreshing instance network info cache due to event network-changed-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:42:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2efccfd9-1ed2-4ef9-9941-cec2773898fb req-c5cedd90-6b48-4fff-bf96-f66a5055fc0b service nova] Acquiring lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:42:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2efccfd9-1ed2-4ef9-9941-cec2773898fb req-c5cedd90-6b48-4fff-bf96-f66a5055fc0b service nova] Acquired lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:42:08 user nova-compute[73029]: DEBUG nova.network.neutron [req-2efccfd9-1ed2-4ef9-9941-cec2773898fb req-c5cedd90-6b48-4fff-bf96-f66a5055fc0b service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Refreshing network info cache for port 2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:42:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:08 user nova-compute[73029]: DEBUG nova.network.neutron [req-2efccfd9-1ed2-4ef9-9941-cec2773898fb req-c5cedd90-6b48-4fff-bf96-f66a5055fc0b service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Updated VIF entry in instance network info cache for port 2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:42:08 user nova-compute[73029]: DEBUG nova.network.neutron [req-2efccfd9-1ed2-4ef9-9941-cec2773898fb req-c5cedd90-6b48-4fff-bf96-f66a5055fc0b service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Updating instance_info_cache with network_info: [{"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:42:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-2efccfd9-1ed2-4ef9-9941-cec2773898fb req-c5cedd90-6b48-4fff-bf96-f66a5055fc0b service nova] Releasing lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-b8b8425e-2649-4260-b7b5-a2c6ad930f8f req-55ba126e-7ceb-48b4-b54b-16c63499793f service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received event network-changed-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG nova.compute.manager [req-b8b8425e-2649-4260-b7b5-a2c6ad930f8f req-55ba126e-7ceb-48b4-b54b-16c63499793f service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Refreshing instance network info cache due to event network-changed-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b8b8425e-2649-4260-b7b5-a2c6ad930f8f req-55ba126e-7ceb-48b4-b54b-16c63499793f service nova] Acquiring lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b8b8425e-2649-4260-b7b5-a2c6ad930f8f req-55ba126e-7ceb-48b4-b54b-16c63499793f service nova] Acquired lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG nova.network.neutron [req-b8b8425e-2649-4260-b7b5-a2c6ad930f8f req-55ba126e-7ceb-48b4-b54b-16c63499793f service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Refreshing network info cache for port 2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:42:09 user nova-compute[73029]: INFO nova.compute.manager [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Terminating instance
Aug 10 01:42:09 user nova-compute[73029]: DEBUG nova.compute.manager [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG nova.network.neutron [req-b8b8425e-2649-4260-b7b5-a2c6ad930f8f req-55ba126e-7ceb-48b4-b54b-16c63499793f service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Updated VIF entry in instance network info cache for port 2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG nova.network.neutron [req-b8b8425e-2649-4260-b7b5-a2c6ad930f8f req-55ba126e-7ceb-48b4-b54b-16c63499793f service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Updating instance_info_cache with network_info: [{"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:42:09 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-b8b8425e-2649-4260-b7b5-a2c6ad930f8f req-55ba126e-7ceb-48b4-b54b-16c63499793f service nova] Releasing lock "refresh_cache-f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:42:10 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Instance destroyed successfully.
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'resources' on Instance uuid f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1305997313',display_name='tempest-TestVolumeBootPattern-server-1305997313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1305997313',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsN3fyjSXLeCAvLwIFHAU50CtGMLPOymRkuIm3USr6fHM9U54knreLKzrTnyfmMAZntkzxCoQ4pgf2Dl+Es17Bzu9e/k9ShzPAEQSs6hilfL5Bjdq5fcf2C+5KqnZtUA==',key_name='tempest-TestVolumeBootPattern-1218773818',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:40:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-6hrxbiia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:40:31Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "address": "fa:16:3e:22:40:c2", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dacd6a2-f1", "ovs_interfaceid": "2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:40:c2,bridge_name='br-int',has_traffic_filtering=True,id=2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dacd6a2-f1') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_vif [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:40:c2,bridge_name='br-int',has_traffic_filtering=True,id=2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dacd6a2-f1') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dacd6a2-f1, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:42:10 user nova-compute[73029]: INFO os_vif [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:40:c2,bridge_name='br-int',has_traffic_filtering=True,id=2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dacd6a2-f1')
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZcFvRnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:42:10 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477d812-71d2-4cdb-85bc-843cc93760c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[18836580-085b-465e-a217-e589ea9403b2]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:42:10 user nova-compute[73029]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 (non-flash)
Aug 10 01:42:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:42:10 user nova-compute[73029]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 (non-flash)
Aug 10 01:42:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751c191e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27'): ({'sdc'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Removing single pathed devices sdc {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[87517eba-9cfe-4e57-8a6e-cddc20afd74e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb04e1b7-b01b-4e1b-bb15-eb6524465129]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flushing IO for device /dev/sdc {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a536e3f-7fb3-4690-8e3e-7e89222aaccc]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7db276c-7601-45ff-a9fc-7af37b5305b3]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] SCSI volumes sdc have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9831bd13-e63b9e9240b5e15c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9831bd13', '/dev/disk/by-id/scsi-26536336239653932') {{(pid=84041) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6491e-7eca-4377-99bd-ea26e6ae4de8]: (4, None) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dfba63-e4b9-4226-8f62-3edcff0dfb10]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc6504-987f-4071-a426-ddabec0dd870]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27, portal: 172.16.0.220,3260]
Aug 10 01:42:10 user nova-compute[73029]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27, portal: 172.16.0.220,3260] successful.
Aug 10 01:42:10 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f30d402-94be-4571-86db-f5ba60e6af27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c320e4c-e2d4-45d2-9602-e2d9008ddb1f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== disconnect_volume: return (288ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:42:10 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Deleting instance files /opt/stack/data/nova/instances/f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f_del
Aug 10 01:42:10 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Deletion of /opt/stack/data/nova/instances/f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f_del complete
Aug 10 01:42:10 user nova-compute[73029]: INFO nova.compute.manager [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received event network-vif-unplugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] Acquiring lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] No waiting events found dispatching network-vif-unplugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received event network-vif-unplugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received event network-vif-plugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] Acquiring lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.compute.manager [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] No waiting events found dispatching network-vif-plugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:42:10 user nova-compute[73029]: WARNING nova.compute.manager [req-c8ed4570-f278-425a-9f2b-e9a878cb67fd req-c389e788-7967-42e0-bb4b-b281aee5938c service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received unexpected event network-vif-plugged-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 for instance with vm_state active and task_state deleting.
Aug 10 01:42:10 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:42:10 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Took 0.45 seconds to deallocate network for instance.
Aug 10 01:42:11 user nova-compute[73029]: INFO nova.compute.manager [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Took 0.74 seconds to detach 1 volumes for instance.
Aug 10 01:42:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:42:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:42:11 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:42:11 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:42:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:42:11 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Deleted allocations for instance f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f
Aug 10 01:42:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-be441156-7d5d-427a-840a-2b33e87a7b77 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.632s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:42:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:12 user nova-compute[73029]: DEBUG nova.compute.manager [req-d8ceae2a-89e4-4154-9ee5-94953c1f4730 req-bf1bc16b-49b7-4b16-a65d-32a8728eea37 service nova] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Received event network-vif-deleted-2dacd6a2-f1d5-4bd7-b022-24fdc0eb9482 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:42:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:42:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.006s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73029) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 10 01:42:22 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:42:22 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=24.994876861572266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance be71c328-6449-4440-8d86-a3f72eb315da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:42:22 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:42:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid be71c328-6449-4440-8d86-a3f72eb315da {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updating instance_info_cache with network_info: [{"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:42:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:42:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:42:25 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691631730.0426679, f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:42:25 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] VM Stopped (Lifecycle Event)
Aug 10 01:42:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:42:25 user nova-compute[73029]: DEBUG nova.compute.manager [None req-6d74fbce-3733-43a9-91d0-fcf50b6b8e84 None None] [instance: f9f75ee6-8536-4ef3-a29a-9d3e5f17a84f] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:42:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:42:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:44 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:44 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:42:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:42:53 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:42:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:43:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-412d0066-e8cd-4b29-ba6e-676cf6e0f87d req-d75b4045-6816-4869-9394-6dbdd1967e0c service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-changed-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-412d0066-e8cd-4b29-ba6e-676cf6e0f87d req-d75b4045-6816-4869-9394-6dbdd1967e0c service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Refreshing instance network info cache due to event network-changed-3da49895-08df-44aa-b649-713fc4d4f25e. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-412d0066-e8cd-4b29-ba6e-676cf6e0f87d req-d75b4045-6816-4869-9394-6dbdd1967e0c service nova] Acquiring lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-412d0066-e8cd-4b29-ba6e-676cf6e0f87d req-d75b4045-6816-4869-9394-6dbdd1967e0c service nova] Acquired lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG nova.network.neutron [req-412d0066-e8cd-4b29-ba6e-676cf6e0f87d req-d75b4045-6816-4869-9394-6dbdd1967e0c service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Refreshing network info cache for port 3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "be71c328-6449-4440-8d86-a3f72eb315da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:11 user nova-compute[73029]: INFO nova.compute.manager [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Terminating instance
Aug 10 01:43:11 user nova-compute[73029]: DEBUG nova.compute.manager [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-c7f3f678-4b38-4ee5-8d6b-81a9e71ba8dd req-7b90620b-4a66-433c-b270-d2b3aed8e34b service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-unplugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c7f3f678-4b38-4ee5-8d6b-81a9e71ba8dd req-7b90620b-4a66-433c-b270-d2b3aed8e34b service nova] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c7f3f678-4b38-4ee5-8d6b-81a9e71ba8dd req-7b90620b-4a66-433c-b270-d2b3aed8e34b service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-c7f3f678-4b38-4ee5-8d6b-81a9e71ba8dd req-7b90620b-4a66-433c-b270-d2b3aed8e34b service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-c7f3f678-4b38-4ee5-8d6b-81a9e71ba8dd req-7b90620b-4a66-433c-b270-d2b3aed8e34b service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] No waiting events found dispatching network-vif-unplugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:43:11 user nova-compute[73029]: DEBUG nova.compute.manager [req-c7f3f678-4b38-4ee5-8d6b-81a9e71ba8dd req-7b90620b-4a66-433c-b270-d2b3aed8e34b service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-unplugged-3da49895-08df-44aa-b649-713fc4d4f25e for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Instance destroyed successfully.
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.objects.instance [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lazy-loading 'resources' on Instance uuid be71c328-6449-4440-8d86-a3f72eb315da {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-686929643',display_name='tempest-TestVolumeBootPattern-server-686929643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-686929643',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsN3fyjSXLeCAvLwIFHAU50CtGMLPOymRkuIm3USr6fHM9U54knreLKzrTnyfmMAZntkzxCoQ4pgf2Dl+Es17Bzu9e/k9ShzPAEQSs6hilfL5Bjdq5fcf2C+5KqnZtUA==',key_name='tempest-TestVolumeBootPattern-1218773818',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:38:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b217381b301d4650bc046a0031d044a7',ramdisk_id='',reservation_id='r-xapek2dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1870123799',owner_user_name='tempest-TestVolumeBootPattern-1870123799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:38:26Z,user_data=None,user_id='44698a7ae911479eb2d5d8a8103ac5dd',uuid=be71c328-6449-4440-8d86-a3f72eb315da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converting VIF {"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:95:7e,bridge_name='br-int',has_traffic_filtering=True,id=3da49895-08df-44aa-b649-713fc4d4f25e,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da49895-08') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_vif [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:95:7e,bridge_name='br-int',has_traffic_filtering=True,id=3da49895-08df-44aa-b649-713fc4d4f25e,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da49895-08') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3da49895-08, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:43:12 user nova-compute[73029]: INFO os_vif [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:95:7e,bridge_name='br-int',has_traffic_filtering=True,id=3da49895-08df-44aa-b649-713fc4d4f25e,network=Network(513a4497-ff5e-4436-a48d-bc38bbed9468),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da49895-08')
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEMsZkJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:43:12 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f7b78-5ecd-4e28-ba36-26dccab5c17f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb877d3-c5ca-4eb2-8d4d-69f4ccde4043]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:43:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 (non-flash)
Aug 10 01:43:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7528c0b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab77e1-cc4e-4ad8-a333-6cefe5f393ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2274b4-da25-41ae-8ca0-07f86c8455c5]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e284902-dd55-441c-82ad-60b05a6d705d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e75ff1b-b314-4837-8e9f-7bddd54891d5]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO587522d4-bf3b903666f8e7cf', '/dev/disk/by-id/scsi-26266336239303336', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_587522d4') {{(pid=84041) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c53053-851c-4c7b-9077-82b82e497744]: (4, None) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff36db1e-840e-4acc-a918-a1c3d75f18a9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.network.neutron [req-412d0066-e8cd-4b29-ba6e-676cf6e0f87d req-d75b4045-6816-4869-9394-6dbdd1967e0c service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updated VIF entry in instance network info cache for port 3da49895-08df-44aa-b649-713fc4d4f25e. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.network.neutron [req-412d0066-e8cd-4b29-ba6e-676cf6e0f87d req-d75b4045-6816-4869-9394-6dbdd1967e0c service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updating instance_info_cache with network_info: [{"id": "3da49895-08df-44aa-b649-713fc4d4f25e", "address": "fa:16:3e:d1:95:7e", "network": {"id": "513a4497-ff5e-4436-a48d-bc38bbed9468", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-928752368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b217381b301d4650bc046a0031d044a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da49895-08", "ovs_interfaceid": "3da49895-08df-44aa-b649-713fc4d4f25e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-412d0066-e8cd-4b29-ba6e-676cf6e0f87d req-d75b4045-6816-4869-9394-6dbdd1967e0c service nova] Releasing lock "refresh_cache-be71c328-6449-4440-8d86-a3f72eb315da" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6779c4-5f41-4966-95a7-4145bedb81e1]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260]
Aug 10 01:43:12 user nova-compute[73029]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197, portal: 172.16.0.220,3260] successful.
Aug 10 01:43:12 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7eb13d8-e332-4ede-9d39-9d603cb50197 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e18388-7965-41ac-a99e-347ac76df603]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] <== disconnect_volume: return (325ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:43:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Deleting instance files /opt/stack/data/nova/instances/be71c328-6449-4440-8d86-a3f72eb315da_del
Aug 10 01:43:12 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Deletion of /opt/stack/data/nova/instances/be71c328-6449-4440-8d86-a3f72eb315da_del complete
Aug 10 01:43:12 user nova-compute[73029]: INFO nova.compute.manager [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 10 01:43:12 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: be71c328-6449-4440-8d86-a3f72eb315da] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:43:13 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Took 0.50 seconds to deallocate network for instance.
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-164b3708-c756-4ac8-86e5-633d9ce2d3d8 req-b989117c-94c3-484f-8948-ec4ed61794a2 service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-deleted-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] No waiting events found dispatching network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:43:13 user nova-compute[73029]: WARNING nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received unexpected event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e for instance with vm_state active and task_state deleting.
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] No waiting events found dispatching network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:43:13 user nova-compute[73029]: WARNING nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received unexpected event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e for instance with vm_state active and task_state deleting.
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] No waiting events found dispatching network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:43:13 user nova-compute[73029]: WARNING nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received unexpected event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e for instance with vm_state active and task_state deleting.
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-unplugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] No waiting events found dispatching network-vif-unplugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-unplugged-3da49895-08df-44aa-b649-713fc4d4f25e for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Acquiring lock "be71c328-6449-4440-8d86-a3f72eb315da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] Lock "be71c328-6449-4440-8d86-a3f72eb315da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:13 user nova-compute[73029]: DEBUG nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] No waiting events found dispatching network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:43:13 user nova-compute[73029]: WARNING nova.compute.manager [req-6a986743-7ffb-4515-899d-832b9118afe3 req-f54b2716-d7a6-4c50-b155-24bb0293d6dc service nova] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Received unexpected event network-vif-plugged-3da49895-08df-44aa-b649-713fc4d4f25e for instance with vm_state active and task_state deleting.
Aug 10 01:43:14 user nova-compute[73029]: INFO nova.compute.manager [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Took 0.75 seconds to detach 1 volumes for instance.
Aug 10 01:43:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:14 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:43:14 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:43:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:14 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Deleted allocations for instance be71c328-6449-4440-8d86-a3f72eb315da
Aug 10 01:43:14 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-561809a6-ee5f-4380-983d-1bafff404af0 tempest-TestVolumeBootPattern-1870123799 tempest-TestVolumeBootPattern-1870123799-project-member] Lock "be71c328-6449-4440-8d86-a3f72eb315da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.769s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:43:19 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:43:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:43:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:43:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:43:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:43:24 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:43:24 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:43:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=24.993865966796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:43:24 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:43:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:43:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:43:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:43:26 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:43:27 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691631792.3183005, be71c328-6449-4440-8d86-a3f72eb315da => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:43:27 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: be71c328-6449-4440-8d86-a3f72eb315da] VM Stopped (Lifecycle Event)
Aug 10 01:43:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-c247a590-f487-42a4-8116-d40a3054fb8a None None] [instance: be71c328-6449-4440-8d86-a3f72eb315da] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:43:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:43:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:43:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:43:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:43:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:43:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:43:59 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:44:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:44:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:44:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:44:26 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:44:26 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=24.98468017578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:44:26 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:44:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:44:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:44:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:44:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:44:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:44:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:44:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:09 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:45:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:45:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:45:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:45:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:45:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:45:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:45:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:27 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:45:27 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=24.983348846435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:45:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:45:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:45:37 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:42 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:52 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:45:57 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:02 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:07 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:11 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:11 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:12 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:16 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:17 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:21 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:46:22 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:26 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:46:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:46:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:46:27 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:46:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:46:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8614MB free_disk=24.97803497314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:46:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:46:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:46:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Starting instance... {{(pid=73029) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 10 01:46:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:46:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:46:30 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73029) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 10 01:46:30 user nova-compute[73029]: INFO nova.compute.claims [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Claim successful on node user
Aug 10 01:46:30 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:46:30 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:46:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:46:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Start building networks asynchronously for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 10 01:46:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Allocating IP information in the background. {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 10 01:46:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] allocate_for_instance() {{(pid=73029) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 10 01:46:30 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 10 01:46:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Start building block device mappings for instance. {{(pid=73029) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 10 01:46:30 user nova-compute[73029]: DEBUG nova.policy [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57c45789bf604c068eb0d8712aa356eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59a39c2fee64557ba443528a6743162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73029) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Start spawning the instance on the hypervisor. {{(pid=73029) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Creating instance directory {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 10 01:46:31 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Creating image(s)
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "/opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "/opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.041s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.306s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "095856791146cea2d29c6c3de56a43047bccb6cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.171s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk 1073741824 {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf,backing_fmt=raw /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk 1073741824" returned: 0 in 0.066s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "095856791146cea2d29c6c3de56a43047bccb6cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:46:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf --force-share --output=json" returned: 0 in 0.189s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk. size=1073741824 {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG nova.virt.disk.api [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Cannot resize image /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk to a smaller size. {{(pid=73029) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'migration_context' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Created local disks {{(pid=73029) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Ensure instance console log exists: /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/console.log {{(pid=73029) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Successfully created port: 9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 10 01:46:32 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Successfully updated port: 9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 10 01:46:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:46:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:46:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Building network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 10 01:46:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Instance cache missing network info. {{(pid=73029) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 10 01:46:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-35dfa719-16f5-4caa-b33f-1709694fe72a req-805d007f-53d4-4119-ac3f-baa84223aaf0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received event network-changed-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:46:33 user nova-compute[73029]: DEBUG nova.compute.manager [req-35dfa719-16f5-4caa-b33f-1709694fe72a req-805d007f-53d4-4119-ac3f-baa84223aaf0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Refreshing instance network info cache due to event network-changed-9b752213-8099-492c-92c6-ac55ee922355. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:46:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-35dfa719-16f5-4caa-b33f-1709694fe72a req-805d007f-53d4-4119-ac3f-baa84223aaf0 service nova] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.network.neutron [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Instance network_info: |[{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73029) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-35dfa719-16f5-4caa-b33f-1709694fe72a req-805d007f-53d4-4119-ac3f-baa84223aaf0 service nova] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-35dfa719-16f5-4caa-b33f-1709694fe72a req-805d007f-53d4-4119-ac3f-baa84223aaf0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Refreshing network info cache for port 9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Start _get_guest_xml network_info=[{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'image_id': '48fbc2bc-b0d2-49bf-97dd-ed057d979427'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 10 01:46:34 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:46:34 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] CPU controller missing on host. {{(pid=73029) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.host [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] CPU controller found on host. {{(pid=73029) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73029) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-10T00:31:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-10T00:31:34Z,direct_url=<?>,disk_format='qcow2',id=48fbc2bc-b0d2-49bf-97dd-ed057d979427,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6fd81ae74ec04fb78f9e02c2f17a58cd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-10T00:31:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Flavor limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Image limits 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Flavor pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Image pref 0:0:0 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Got 1 possible topologies {{(pid=73029) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.hardware [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73029) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1272785431',display_name='tempest-SnapshotDataIntegrityTests-server-1272785431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1272785431',id=52,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF2b41aLIKzgNbLRBKzFNxDQKVT2Gs9tUlDSnOiR4xMpRg7H86vHjGKe8s+M6cOBTcjRT06R/b1GvKVMt4I49g/GfEaWtymHDBW3L9FaI/fZ5YkD6FPiGcBpK5eIp22iQ==',key_name='tempest-keypair-1838588018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e59a39c2fee64557ba443528a6743162',ramdisk_id='',reservation_id='r-7wu0jhvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2044714506',owner_user_name='tempest-SnapshotDataIntegrityTests-2044714506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57c45789bf604c068eb0d8712aa356eb',uuid=f8d61c85-345b-4f89-8f94-63041570edc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73029) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Converting VIF {"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e3:19,bridge_name='br-int',has_traffic_filtering=True,id=9b752213-8099-492c-92c6-ac55ee922355,network=Network(d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b752213-80') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.objects.instance [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'pci_devices' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] End _get_guest_xml xml=<domain type="kvm">
Aug 10 01:46:34 user nova-compute[73029]:   <uuid>f8d61c85-345b-4f89-8f94-63041570edc9</uuid>
Aug 10 01:46:34 user nova-compute[73029]:   <name>instance-00000034</name>
Aug 10 01:46:34 user nova-compute[73029]:   <memory>524288</memory>
Aug 10 01:46:34 user nova-compute[73029]:   <vcpu>1</vcpu>
Aug 10 01:46:34 user nova-compute[73029]:   <metadata>
Aug 10 01:46:34 user nova-compute[73029]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 10 01:46:34 user nova-compute[73029]:       <nova:package version="0.0.0"/>
Aug 10 01:46:34 user nova-compute[73029]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1272785431</nova:name>
Aug 10 01:46:34 user nova-compute[73029]:       <nova:creationTime>2023-08-10 01:46:34</nova:creationTime>
Aug 10 01:46:34 user nova-compute[73029]:       <nova:flavor name="m1.tiny">
Aug 10 01:46:34 user nova-compute[73029]:         <nova:memory>512</nova:memory>
Aug 10 01:46:34 user nova-compute[73029]:         <nova:disk>1</nova:disk>
Aug 10 01:46:34 user nova-compute[73029]:         <nova:swap>0</nova:swap>
Aug 10 01:46:34 user nova-compute[73029]:         <nova:ephemeral>0</nova:ephemeral>
Aug 10 01:46:34 user nova-compute[73029]:         <nova:vcpus>1</nova:vcpus>
Aug 10 01:46:34 user nova-compute[73029]:       </nova:flavor>
Aug 10 01:46:34 user nova-compute[73029]:       <nova:owner>
Aug 10 01:46:34 user nova-compute[73029]:         <nova:user uuid="57c45789bf604c068eb0d8712aa356eb">tempest-SnapshotDataIntegrityTests-2044714506-project-member</nova:user>
Aug 10 01:46:34 user nova-compute[73029]:         <nova:project uuid="e59a39c2fee64557ba443528a6743162">tempest-SnapshotDataIntegrityTests-2044714506</nova:project>
Aug 10 01:46:34 user nova-compute[73029]:       </nova:owner>
Aug 10 01:46:34 user nova-compute[73029]:       <nova:root type="image" uuid="48fbc2bc-b0d2-49bf-97dd-ed057d979427"/>
Aug 10 01:46:34 user nova-compute[73029]:       <nova:ports>
Aug 10 01:46:34 user nova-compute[73029]:         <nova:port uuid="9b752213-8099-492c-92c6-ac55ee922355">
Aug 10 01:46:34 user nova-compute[73029]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 10 01:46:34 user nova-compute[73029]:         </nova:port>
Aug 10 01:46:34 user nova-compute[73029]:       </nova:ports>
Aug 10 01:46:34 user nova-compute[73029]:     </nova:instance>
Aug 10 01:46:34 user nova-compute[73029]:   </metadata>
Aug 10 01:46:34 user nova-compute[73029]:   <sysinfo type="smbios">
Aug 10 01:46:34 user nova-compute[73029]:     <system>
Aug 10 01:46:34 user nova-compute[73029]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 10 01:46:34 user nova-compute[73029]:       <entry name="product">OpenStack Nova</entry>
Aug 10 01:46:34 user nova-compute[73029]:       <entry name="version">0.0.0</entry>
Aug 10 01:46:34 user nova-compute[73029]:       <entry name="serial">f8d61c85-345b-4f89-8f94-63041570edc9</entry>
Aug 10 01:46:34 user nova-compute[73029]:       <entry name="uuid">f8d61c85-345b-4f89-8f94-63041570edc9</entry>
Aug 10 01:46:34 user nova-compute[73029]:       <entry name="family">Virtual Machine</entry>
Aug 10 01:46:34 user nova-compute[73029]:     </system>
Aug 10 01:46:34 user nova-compute[73029]:   </sysinfo>
Aug 10 01:46:34 user nova-compute[73029]:   <os>
Aug 10 01:46:34 user nova-compute[73029]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 10 01:46:34 user nova-compute[73029]:     <boot dev="hd"/>
Aug 10 01:46:34 user nova-compute[73029]:     <smbios mode="sysinfo"/>
Aug 10 01:46:34 user nova-compute[73029]:   </os>
Aug 10 01:46:34 user nova-compute[73029]:   <features>
Aug 10 01:46:34 user nova-compute[73029]:     <acpi/>
Aug 10 01:46:34 user nova-compute[73029]:     <apic/>
Aug 10 01:46:34 user nova-compute[73029]:     <vmcoreinfo/>
Aug 10 01:46:34 user nova-compute[73029]:   </features>
Aug 10 01:46:34 user nova-compute[73029]:   <clock offset="utc">
Aug 10 01:46:34 user nova-compute[73029]:     <timer name="pit" tickpolicy="delay"/>
Aug 10 01:46:34 user nova-compute[73029]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 10 01:46:34 user nova-compute[73029]:     <timer name="hpet" present="no"/>
Aug 10 01:46:34 user nova-compute[73029]:   </clock>
Aug 10 01:46:34 user nova-compute[73029]:   <cpu mode="custom" match="exact">
Aug 10 01:46:34 user nova-compute[73029]:     <model>Nehalem</model>
Aug 10 01:46:34 user nova-compute[73029]:     <topology sockets="1" cores="1" threads="1"/>
Aug 10 01:46:34 user nova-compute[73029]:   </cpu>
Aug 10 01:46:34 user nova-compute[73029]:   <devices>
Aug 10 01:46:34 user nova-compute[73029]:     <disk type="file" device="disk">
Aug 10 01:46:34 user nova-compute[73029]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 10 01:46:34 user nova-compute[73029]:       <source file="/opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk"/>
Aug 10 01:46:34 user nova-compute[73029]:       <target dev="vda" bus="virtio"/>
Aug 10 01:46:34 user nova-compute[73029]:     </disk>
Aug 10 01:46:34 user nova-compute[73029]:     <interface type="ethernet">
Aug 10 01:46:34 user nova-compute[73029]:       <mac address="fa:16:3e:57:e3:19"/>
Aug 10 01:46:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:46:34 user nova-compute[73029]:       <mtu size="1442"/>
Aug 10 01:46:34 user nova-compute[73029]:       <target dev="tap9b752213-80"/>
Aug 10 01:46:34 user nova-compute[73029]:     </interface>
Aug 10 01:46:34 user nova-compute[73029]:     <serial type="pty">
Aug 10 01:46:34 user nova-compute[73029]:       <log file="/opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/console.log" append="off"/>
Aug 10 01:46:34 user nova-compute[73029]:     </serial>
Aug 10 01:46:34 user nova-compute[73029]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 10 01:46:34 user nova-compute[73029]:     <video>
Aug 10 01:46:34 user nova-compute[73029]:       <model type="virtio"/>
Aug 10 01:46:34 user nova-compute[73029]:     </video>
Aug 10 01:46:34 user nova-compute[73029]:     <rng model="virtio">
Aug 10 01:46:34 user nova-compute[73029]:       <backend model="random">/dev/urandom</backend>
Aug 10 01:46:34 user nova-compute[73029]:     </rng>
Aug 10 01:46:34 user nova-compute[73029]:     <controller type="usb" index="0" model="none"/>
Aug 10 01:46:34 user nova-compute[73029]:     <memballoon model="virtio">
Aug 10 01:46:34 user nova-compute[73029]:       <stats period="10"/>
Aug 10 01:46:34 user nova-compute[73029]:     </memballoon>
Aug 10 01:46:34 user nova-compute[73029]:   </devices>
Aug 10 01:46:34 user nova-compute[73029]: </domain>
Aug 10 01:46:34 user nova-compute[73029]:  {{(pid=73029) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1272785431',display_name='tempest-SnapshotDataIntegrityTests-server-1272785431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1272785431',id=52,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF2b41aLIKzgNbLRBKzFNxDQKVT2Gs9tUlDSnOiR4xMpRg7H86vHjGKe8s+M6cOBTcjRT06R/b1GvKVMt4I49g/GfEaWtymHDBW3L9FaI/fZ5YkD6FPiGcBpK5eIp22iQ==',key_name='tempest-keypair-1838588018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e59a39c2fee64557ba443528a6743162',ramdisk_id='',reservation_id='r-7wu0jhvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2044714506',owner_user_name='tempest-SnapshotDataIntegrityTests-2044714506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-10T01:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57c45789bf604c068eb0d8712aa356eb',uuid=f8d61c85-345b-4f89-8f94-63041570edc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Converting VIF {"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e3:19,bridge_name='br-int',has_traffic_filtering=True,id=9b752213-8099-492c-92c6-ac55ee922355,network=Network(d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b752213-80') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG os_vif [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e3:19,bridge_name='br-int',has_traffic_filtering=True,id=9b752213-8099-492c-92c6-ac55ee922355,network=Network(d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b752213-80') {{(pid=73029) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b752213-80, may_exist=True, interface_attrs={}) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b752213-80, col_values=(('external_ids', {'iface-id': '9b752213-8099-492c-92c6-ac55ee922355', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:e3:19', 'vm-uuid': 'f8d61c85-345b-4f89-8f94-63041570edc9'}),), if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:34 user nova-compute[73029]: INFO os_vif [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e3:19,bridge_name='br-int',has_traffic_filtering=True,id=9b752213-8099-492c-92c6-ac55ee922355,network=Network(d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b752213-80')
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No VIF found with MAC fa:16:3e:57:e3:19, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-35dfa719-16f5-4caa-b33f-1709694fe72a req-805d007f-53d4-4119-ac3f-baa84223aaf0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updated VIF entry in instance network info cache for port 9b752213-8099-492c-92c6-ac55ee922355. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG nova.network.neutron [req-35dfa719-16f5-4caa-b33f-1709694fe72a req-805d007f-53d4-4119-ac3f-baa84223aaf0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:46:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-35dfa719-16f5-4caa-b33f-1709694fe72a req-805d007f-53d4-4119-ac3f-baa84223aaf0 service nova] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:46:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-8895232a-7faa-4847-80cf-283693ad2e38 req-855d9bc0-6162-466b-b226-5e2376ec11a0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received event network-vif-plugged-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:46:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8895232a-7faa-4847-80cf-283693ad2e38 req-855d9bc0-6162-466b-b226-5e2376ec11a0 service nova] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:46:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8895232a-7faa-4847-80cf-283693ad2e38 req-855d9bc0-6162-466b-b226-5e2376ec11a0 service nova] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:46:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-8895232a-7faa-4847-80cf-283693ad2e38 req-855d9bc0-6162-466b-b226-5e2376ec11a0 service nova] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:46:36 user nova-compute[73029]: DEBUG nova.compute.manager [req-8895232a-7faa-4847-80cf-283693ad2e38 req-855d9bc0-6162-466b-b226-5e2376ec11a0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] No waiting events found dispatching network-vif-plugged-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:46:36 user nova-compute[73029]: WARNING nova.compute.manager [req-8895232a-7faa-4847-80cf-283693ad2e38 req-855d9bc0-6162-466b-b226-5e2376ec11a0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received unexpected event network-vif-plugged-9b752213-8099-492c-92c6-ac55ee922355 for instance with vm_state building and task_state spawning.
Aug 10 01:46:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:36 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631998.812024, f8d61c85-345b-4f89-8f94-63041570edc9 => Resumed> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:46:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] VM Resumed (Lifecycle Event)
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Instance event wait completed in 0 seconds for  {{(pid=73029) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Guest created on hypervisor {{(pid=73029) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 10 01:46:38 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Instance spawned successfully.
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Found default for hw_cdrom_bus of ide {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Found default for hw_disk_bus of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Found default for hw_input_bus of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Found default for hw_pointer_model of None {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Found default for hw_video_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Found default for hw_vif_model of virtio {{(pid=73029) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:46:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.virt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Emitting event <LifecycleEvent: 1691631998.8138025, f8d61c85-345b-4f89-8f94-63041570edc9 => Started> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:46:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] VM Started (Lifecycle Event)
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73029) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 10 01:46:38 user nova-compute[73029]: INFO nova.compute.manager [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 10 01:46:38 user nova-compute[73029]: INFO nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Took 7.77 seconds to spawn the instance on the hypervisor.
Aug 10 01:46:38 user nova-compute[73029]: DEBUG nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:46:39 user nova-compute[73029]: INFO nova.compute.manager [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Took 9.12 seconds to build instance.
Aug 10 01:46:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-2936cb7f-b13b-45e8-82d8-d50c597c0b5e tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.265s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:46:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-3d345b7d-3488-4aa8-a852-18e1ccf392d6 req-9ba92962-2124-4373-b47f-1df43e1828c0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received event network-vif-plugged-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:46:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3d345b7d-3488-4aa8-a852-18e1ccf392d6 req-9ba92962-2124-4373-b47f-1df43e1828c0 service nova] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:46:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3d345b7d-3488-4aa8-a852-18e1ccf392d6 req-9ba92962-2124-4373-b47f-1df43e1828c0 service nova] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:46:39 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-3d345b7d-3488-4aa8-a852-18e1ccf392d6 req-9ba92962-2124-4373-b47f-1df43e1828c0 service nova] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:46:39 user nova-compute[73029]: DEBUG nova.compute.manager [req-3d345b7d-3488-4aa8-a852-18e1ccf392d6 req-9ba92962-2124-4373-b47f-1df43e1828c0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] No waiting events found dispatching network-vif-plugged-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:46:39 user nova-compute[73029]: WARNING nova.compute.manager [req-3d345b7d-3488-4aa8-a852-18e1ccf392d6 req-9ba92962-2124-4373-b47f-1df43e1828c0 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received unexpected event network-vif-plugged-9b752213-8099-492c-92c6-ac55ee922355 for instance with vm_state building and task_state spawning.
Aug 10 01:46:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:43 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:46:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:46:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:13 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:47:21 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:21 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:47:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:47:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:47:28 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:47:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=24.93738555908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f8d61c85-345b-4f89-8f94-63041570edc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:47:28 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:47:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:47:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:47:37 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:47:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:47:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:47:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:47:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:47:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:47:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:47:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:47:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:47:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:47:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:54 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:47:54 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:47:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:47:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:47:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:47:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:47:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:47:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:48:03 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:48:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:48:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:48:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:48:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c7c73b8-a28f-44ad-aaf8-78e313dfe532 req-39d8f89a-3c82-45b6-b13f-da2f0ac98389 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received event network-changed-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:48:21 user nova-compute[73029]: DEBUG nova.compute.manager [req-4c7c73b8-a28f-44ad-aaf8-78e313dfe532 req-39d8f89a-3c82-45b6-b13f-da2f0ac98389 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Refreshing instance network info cache due to event network-changed-9b752213-8099-492c-92c6-ac55ee922355. {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 10 01:48:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c7c73b8-a28f-44ad-aaf8-78e313dfe532 req-39d8f89a-3c82-45b6-b13f-da2f0ac98389 service nova] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:48:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c7c73b8-a28f-44ad-aaf8-78e313dfe532 req-39d8f89a-3c82-45b6-b13f-da2f0ac98389 service nova] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:48:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-4c7c73b8-a28f-44ad-aaf8-78e313dfe532 req-39d8f89a-3c82-45b6-b13f-da2f0ac98389 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Refreshing network info cache for port 9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 10 01:48:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-4c7c73b8-a28f-44ad-aaf8-78e313dfe532 req-39d8f89a-3c82-45b6-b13f-da2f0ac98389 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updated VIF entry in instance network info cache for port 9b752213-8099-492c-92c6-ac55ee922355. {{(pid=73029) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 10 01:48:21 user nova-compute[73029]: DEBUG nova.network.neutron [req-4c7c73b8-a28f-44ad-aaf8-78e313dfe532 req-39d8f89a-3c82-45b6-b13f-da2f0ac98389 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:48:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-4c7c73b8-a28f-44ad-aaf8-78e313dfe532 req-39d8f89a-3c82-45b6-b13f-da2f0ac98389 service nova] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:48:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:22 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:48:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:48:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:48:25 user nova-compute[73029]: DEBUG nova.objects.instance [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:48:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:48:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:48:25 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:48:25 user nova-compute[73029]: INFO nova.compute.manager [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attaching volume 508c38f0-5fa5-49bd-aa65-7c5ab0aee36a to /dev/vdb
Aug 10 01:48:25 user nova-compute[73029]: DEBUG os_brick.utils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:48:25 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a04347-c777-4e7f-9b8a-91a074781f50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5f2fbd-c9c5-4e86-a5c2-767b07eea383]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[688acd02-7c6f-45e1-9178-ad846f54bd89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df74d73-3c03-42ef-be78-adaf09eb15c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:48:26 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:48:26 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea41cda-c0b3-4051-b25d-95560390ed60]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG os_brick.utils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:48:26 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating existing volume attachment record: e9ef507f-d505-4968-a7a8-0b8c2c449ec2 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:48:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:48:27 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:48:27 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:48:27 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:48:27 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:48:28 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:48:28 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:48:28 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:48:28 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:48:29 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:48:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.936161041259766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f8d61c85-345b-4f89-8f94-63041570edc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:48:29 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:48:30 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:48:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:48:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:48:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:33 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isIRFPrf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:48:34 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:48:34 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:48:34 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afe06d4-0640-425c-96e2-79d8d7715f8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:48:34 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9566071c-27cb-49a1-b0ef-55eec034e73a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a] added
Aug 10 01:48:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b93ba25-2569-447d-ba88-78892aaa0467]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e7fe29-ab6d-40d7-ae35-24b5823a7aea]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isIRFPrf {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isIRFPrf" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb5122e-e6d6-4cdf-8971-433dacdc5c94]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'isIRFPrf'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe684fe-60be-4723-9332-554aa38c5de9]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[098e21dd-84d3-427d-835d-34cedf09a086]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:48:34 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:48:34 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:48:34 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:48:34 user nova-compute[73029]: 
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[31af84a2-82bf-4467-b159-3baf2dc57d6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a, portal: 172.16.0.220,3260]
Aug 10 01:48:34 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a, portal: 172.16.0.220,3260] successful.
Aug 10 01:48:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d8f5c7-6786-42e7-aede-705f49105c8d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c89c335-651e-43cf-a9e4-d447f7b7a6de]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a (non-flash)
Aug 10 01:48:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a (non-flash)
Aug 10 01:48:34 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd8562c-21c6-4d25-899b-8a09530539ac]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:48:34 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:48:35 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:48:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isIRFPrf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:48:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:48:35 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23164643735373538', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:48:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164643735373538', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:48:35 user nova-compute[73029]: DEBUG nova.objects.instance [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:48:35 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:48:35 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:48:35 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:48:35 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:48:35 user nova-compute[73029]:   <serial>508c38f0-5fa5-49bd-aa65-7c5ab0aee36a</serial>
Aug 10 01:48:35 user nova-compute[73029]: </disk>
Aug 10 01:48:35 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:48:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:48:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:48:36 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No VIF found with MAC fa:16:3e:57:e3:19, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:48:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-558c6b2e-287c-42af-a180-7a6ea8d2d14c tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.394s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:48:38 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:48:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:48:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:48:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:48 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:53 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:48:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:48:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:48:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:48:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:48:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:49:00 user nova-compute[73029]: INFO nova.compute.manager [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Detaching volume 508c38f0-5fa5-49bd-aa65-7c5ab0aee36a
Aug 10 01:49:00 user nova-compute[73029]: INFO nova.virt.block_device [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attempting to driver detach volume 508c38f0-5fa5-49bd-aa65-7c5ab0aee36a from mountpoint /dev/vdb
Aug 10 01:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Attempting to detach device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:49:00 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:49:00 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:49:00 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:49:00 user nova-compute[73029]:   <serial>508c38f0-5fa5-49bd-aa65-7c5ab0aee36a</serial>
Aug 10 01:49:00 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:49:00 user nova-compute[73029]: </disk>
Aug 10 01:49:00 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:49:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully detached device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the persistent domain config.
Aug 10 01:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:49:00 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:49:00 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:49:00 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:49:00 user nova-compute[73029]:   <serial>508c38f0-5fa5-49bd-aa65-7c5ab0aee36a</serial>
Aug 10 01:49:00 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:49:00 user nova-compute[73029]: </disk>
Aug 10 01:49:00 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691632140.7430122, f8d61c85-345b-4f89-8f94-63041570edc9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:49:00 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully detached device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the live domain config.
Aug 10 01:49:00 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isIRFPrf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:49:00 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3595b76-9d75-4920-ba77-dfa91e69d93b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9611031c-dba7-4c15-8b6e-1b02c51d0e51]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a (non-flash)
Aug 10 01:49:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a (non-flash)
Aug 10 01:49:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f751c191990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f99c686-9ce3-4475-8a5e-ad538fd13c23]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b871e0-5234-4f2a-93b7-945a22611230]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf1d5ce-e76e-439c-924b-507164ab6d8e]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[75363ee4-0a8a-434a-9af2-da149ca20988]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dba897-7364-472c-9445-a370ecbed983]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd62a37-dffc-4676-b631-1111ecd34e91]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a, portal: 172.16.0.220,3260]
Aug 10 01:49:00 user nova-compute[73029]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a, portal: 172.16.0.220,3260] successful.
Aug 10 01:49:00 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:49:00 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508c38f0-5fa5-49bd-aa65-7c5ab0aee36a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2a1928-a69f-4ec6-b019-bc7f28a3cece]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:49:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:49:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== disconnect_volume: return (247ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:49:01 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:49:01 user nova-compute[73029]: DEBUG nova.objects.instance [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:49:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-fbe41452-4fb3-4905-a3ba-c5420ccef21d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.583s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:49:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:49:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:14 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:49:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:49:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:49:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:49:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:23 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:49:23 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:49:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:49:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:49:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:30 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:49:30 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:49:30 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8746MB free_disk=24.935039520263672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:49:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:49:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f8d61c85-345b-4f89-8f94-63041570edc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:49:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:49:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:49:31 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:49:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:49:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:49:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:49:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:49:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:49:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:49:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:49:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:49:54 user nova-compute[73029]: INFO nova.compute.manager [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attaching volume d74339a3-9b5e-4442-a0f0-091502df68e3 to /dev/vdb
Aug 10 01:49:54 user nova-compute[73029]: DEBUG os_brick.utils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f07c0c-e51f-43fd-8e9e-5fb778aa38f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a833414-6a9e-4c97-b7c2-dd8ad687523b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fb1ab4-81a4-4805-9f04-5c5dbd634ebc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[31002c41-efea-4344-874f-7f3b3e245563]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:49:54 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:49:54 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62cd8f7-0853-44f1-a232-6ac8f07de769]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG os_brick.utils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:49:54 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating existing volume attachment record: 46495ea0-1c20-46c0-9f7e-eb39a95199d2 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:49:58 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:49:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjMhoWpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:50:02 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:50:02 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:50:02 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b2bc1f-a5fa-4297-860c-3365396d6af8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:50:02 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea7d46-679c-4b25-b370-3c3f7b2027ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3] added
Aug 10 01:50:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c7dd5b-2d8d-493d-9be9-25a835c4ac03]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c604d890-01ec-4657-9de6-1baff51449bd]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjMhoWpF {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjMhoWpF" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba795c-d66a-4971-891c-e34a279df3ff]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QjMhoWpF'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[11959fc4-22e5-4bac-8417-b2823297f47b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af62dad-429f-449f-a486-bd93f073fa20]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:50:02 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:50:02 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:50:02 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:50:02 user nova-compute[73029]: 
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54d8de7-546f-4dd2-88ff-d6fd37fe080b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3, portal: 172.16.0.220,3260]
Aug 10 01:50:02 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3, portal: 172.16.0.220,3260] successful.
Aug 10 01:50:02 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:02 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1543c968-2b2e-448f-83ac-a2a97006e87c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d0add3-4c29-4363-80ba-c66024feca75]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 (non-flash)
Aug 10 01:50:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 (non-flash)
Aug 10 01:50:03 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c3384-34a5-4a8a-adce-b74224d95aa4]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:50:03 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjMhoWpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23132666139356131', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132666139356131', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG nova.objects.instance [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:50:04 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:50:04 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:50:04 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:50:04 user nova-compute[73029]:   <serial>d74339a3-9b5e-4442-a0f0-091502df68e3</serial>
Aug 10 01:50:04 user nova-compute[73029]: </disk>
Aug 10 01:50:04 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No VIF found with MAC fa:16:3e:57:e3:19, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:50:04 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-a8f7afd5-3d19-41c7-9f7b-c2e51a2d8de0 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.023s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:50:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:50:06 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:50:06 user nova-compute[73029]: INFO nova.compute.manager [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Detaching volume d74339a3-9b5e-4442-a0f0-091502df68e3
Aug 10 01:50:06 user nova-compute[73029]: INFO nova.virt.block_device [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attempting to driver detach volume d74339a3-9b5e-4442-a0f0-091502df68e3 from mountpoint /dev/vdb
Aug 10 01:50:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Attempting to detach device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:50:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:50:06 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:50:06 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:50:06 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:50:06 user nova-compute[73029]:   <serial>d74339a3-9b5e-4442-a0f0-091502df68e3</serial>
Aug 10 01:50:06 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:50:06 user nova-compute[73029]: </disk>
Aug 10 01:50:06 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:50:06 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully detached device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the persistent domain config.
Aug 10 01:50:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:50:06 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:50:06 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:50:06 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:50:06 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:50:06 user nova-compute[73029]:   <serial>d74339a3-9b5e-4442-a0f0-091502df68e3</serial>
Aug 10 01:50:06 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:50:06 user nova-compute[73029]: </disk>
Aug 10 01:50:06 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691632207.3485882, f8d61c85-345b-4f89-8f94-63041570edc9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:50:07 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully detached device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the live domain config.
Aug 10 01:50:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjMhoWpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:50:07 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec34eb5-43fc-4e70-bddf-ee9e66de27e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7791255f-70ea-447e-99a3-dc6bcb2051a4]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 (non-flash)
Aug 10 01:50:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 (non-flash)
Aug 10 01:50:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75141cf880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c950fac3-cb9f-44b1-8420-04a4e5ee2a70]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91e4b75-57cf-43ba-a1ff-598096839732]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e068f925-c759-44d6-9595-7e6860db5b49]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d69050a-4f2d-4e0c-9094-08a1f0e11644]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa33ce8-3e1a-4b47-913a-d9d0340162e6]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ed69e1-f9e4-4842-a6cc-1164cf7787a5]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3, portal: 172.16.0.220,3260]
Aug 10 01:50:07 user nova-compute[73029]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3, portal: 172.16.0.220,3260] successful.
Aug 10 01:50:07 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74339a3-9b5e-4442-a0f0-091502df68e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ba3224-8f5b-499c-8899-a182d0749f7c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== disconnect_volume: return (313ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:50:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:50:08 user nova-compute[73029]: DEBUG nova.objects.instance [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:50:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-34832113-7e86-41dd-8eed-644941330505 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.627s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:50:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:16 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:19 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:50:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:50:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:50:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:50:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:50:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:50:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:50:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:25 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:50:30 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:50:31 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:50:31 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:50:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=24.93402862548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f8d61c85-345b-4f89-8f94-63041570edc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:50:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:50:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:33 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:34 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:50:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:50:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:50:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:50:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:50:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:50:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:51:00 user nova-compute[73029]: DEBUG nova.objects.instance [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:51:00 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:51:01 user nova-compute[73029]: INFO nova.compute.manager [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attaching volume 7e285ea3-1ffc-4407-a742-88936c78f884 to /dev/vdb
Aug 10 01:51:01 user nova-compute[73029]: DEBUG os_brick.utils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5e6cca-fd32-463c-8395-9315c606ae2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b4ce7a-983d-4d08-9b43-3f2d19ced30b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[108ca313-065d-454f-b8a4-f220ad07d4f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2798066c-9b6c-481b-9912-0b58b552c058]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:51:01 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:51:01 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5946b8-709e-4d9b-a533-c8edc1a5e10c]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG os_brick.utils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:51:01 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating existing volume attachment record: 78505cd5-86f9-4862-8f03-874980820c3d {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:51:03 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.008s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Verify base images {{(pid=73029) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Image id 48fbc2bc-b0d2-49bf-97dd-ed057d979427 yields fingerprint 095856791146cea2d29c6c3de56a43047bccb6cf {{(pid=73029) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] image 48fbc2bc-b0d2-49bf-97dd-ed057d979427 at (/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf): checking
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] image 48fbc2bc-b0d2-49bf-97dd-ed057d979427 at (/opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf): image is in use {{(pid=73029) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73029) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] f8d61c85-345b-4f89-8f94-63041570edc9 is a valid instance name {{(pid=73029) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] f8d61c85-345b-4f89-8f94-63041570edc9 has a disk file {{(pid=73029) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f8d61c85-345b-4f89-8f94-63041570edc9 is backed by 095856791146cea2d29c6c3de56a43047bccb6cf {{(pid=73029) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 10 01:51:07 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015
Aug 10 01:51:07 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308
Aug 10 01:51:07 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668
Aug 10 01:51:07 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e
Aug 10 01:51:07 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed
Aug 10 01:51:07 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167
Aug 10 01:51:07 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee
Aug 10 01:51:07 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9
Aug 10 01:51:07 user nova-compute[73029]: WARNING nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Unknown base file: /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Active base files: /opt/stack/data/nova/instances/_base/095856791146cea2d29c6c3de56a43047bccb6cf
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Removable base files: /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015 /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308 /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668 /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167 /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9 /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/828496fb177a80cf95b71a60d6ad443c1ff9d015
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d8e36725346359ef91f20fc825283ffd1aa20308
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b42d9d0768e49e3623355b93b47864eea08ec668
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bc3de84a9e20267a6555ed6473a8bc77d070723e
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/865f592c527ca81cc950482e21efd2dc4909aaed
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/558cfd98875bd8be74e883813cede1ffc8122167
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a317d37f4688335dca698cfebe1afacca81edbee
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3214e1c05655f4aef52e982af165d64ffdb32db9
Aug 10 01:51:07 user nova-compute[73029]: INFO nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/579b586d048d945736fadf52b73cc94d18b2f7a2
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Verification complete {{(pid=73029) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Verify swap images {{(pid=73029) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 10 01:51:07 user nova-compute[73029]: DEBUG nova.virt.libvirt.imagecache [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Verify ephemeral images {{(pid=73029) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCSUtprG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:51:09 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:51:09 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:51:09 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[66887b77-3e9c-4c76-b71c-04c013cd1e75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:51:09 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62ad53d-332c-449f-9ccd-ae1ad71e4731]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884] added
Aug 10 01:51:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ca4fab-a008-40e2-a3f0-a1826d581083]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c3ad0f-499f-48ac-8b55-ad3df110c710]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vCSUtprG {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vCSUtprG" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b000a4-61d8-4d9c-bca6-fb910fd57f5b]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vCSUtprG'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a20638-dff4-44d4-90bd-e47781bec02c]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb747efd-8020-4cdd-aa94-cfad65572272]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:51:09 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:51:09 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:51:09 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:51:09 user nova-compute[73029]: 
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aefdb2e-a3cb-4bda-8254-155584e043d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884, portal: 172.16.0.220,3260]
Aug 10 01:51:09 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884, portal: 172.16.0.220,3260] successful.
Aug 10 01:51:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[443aaede-ca21-4815-af7b-8b4f34ab6d68]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[708bd0c9-7d09-468f-b71c-88f69bad3f2f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 (non-flash)
Aug 10 01:51:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 (non-flash)
Aug 10 01:51:09 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a138f75-791d-4f6e-bfb3-762eca52d7c6]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:09 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:51:10 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:51:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCSUtprG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:51:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:51:10 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23137323963616538', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:51:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137323963616538', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:51:10 user nova-compute[73029]: DEBUG nova.objects.instance [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:51:10 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:51:10 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:51:10 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:51:10 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:51:10 user nova-compute[73029]:   <serial>7e285ea3-1ffc-4407-a742-88936c78f884</serial>
Aug 10 01:51:10 user nova-compute[73029]: </disk>
Aug 10 01:51:10 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:51:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:51:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:51:11 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No VIF found with MAC fa:16:3e:57:e3:19, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:51:11 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-3d50d523-8dcb-4b0f-a4ba-3fba5cf25985 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.168s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:51:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:51:13 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:51:13 user nova-compute[73029]: INFO nova.compute.manager [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Detaching volume 7e285ea3-1ffc-4407-a742-88936c78f884
Aug 10 01:51:13 user nova-compute[73029]: INFO nova.virt.block_device [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attempting to driver detach volume 7e285ea3-1ffc-4407-a742-88936c78f884 from mountpoint /dev/vdb
Aug 10 01:51:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Attempting to detach device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:51:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:51:13 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:51:13 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:51:13 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:51:13 user nova-compute[73029]:   <serial>7e285ea3-1ffc-4407-a742-88936c78f884</serial>
Aug 10 01:51:13 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:51:13 user nova-compute[73029]: </disk>
Aug 10 01:51:13 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:51:13 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully detached device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the persistent domain config.
Aug 10 01:51:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:51:13 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:51:13 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:51:13 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:51:13 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:51:13 user nova-compute[73029]:   <serial>7e285ea3-1ffc-4407-a742-88936c78f884</serial>
Aug 10 01:51:13 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:51:13 user nova-compute[73029]: </disk>
Aug 10 01:51:13 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:51:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691632274.157039, f8d61c85-345b-4f89-8f94-63041570edc9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:51:14 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully detached device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the live domain config.
Aug 10 01:51:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCSUtprG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:51:14 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f4a93a-4d87-4778-b988-5377f8fccff7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[df90abfb-5aae-479f-992e-22da98e6a867]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 (non-flash)
Aug 10 01:51:14 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 (non-flash)
Aug 10 01:51:14 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f75145132e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da8d161-29e4-4333-b5a4-b38b07831431]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4181a505-8e6a-4732-b62b-f845a028eadf]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a766ad3-8204-477b-afa6-d1b147b05cf3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f882af8e-d307-4474-a1a5-8dc582e328b8]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae690a10-cd58-41f0-8a9a-8d367fb96df3]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0c882d-a791-47fd-8db4-cda111d5edb4]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884, portal: 172.16.0.220,3260]
Aug 10 01:51:14 user nova-compute[73029]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884, portal: 172.16.0.220,3260] successful.
Aug 10 01:51:14 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285ea3-1ffc-4407-a742-88936c78f884 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c863e1de-1a15-4d14-bd26-2c1b4d971402]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== disconnect_volume: return (275ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:51:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:15 user nova-compute[73029]: DEBUG nova.objects.instance [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:51:15 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-08b90847-d65f-4903-bf1d-6e0e4b6bc005 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.662s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:51:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:51:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:51:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:51:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:51:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:27 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:51:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:51:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:51:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:51:31 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:51:33 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:51:33 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:51:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=24.932979583740234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f8d61c85-345b-4f89-8f94-63041570edc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:51:33 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:51:34 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:51:34 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:51:34 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:51:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:51:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:51:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:51:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:51:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:51:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:51:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:52:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:52:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:52:07 user nova-compute[73029]: DEBUG nova.objects.instance [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:52:07 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:52:08 user nova-compute[73029]: INFO nova.compute.manager [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attaching volume 33482417-1fd0-4e3c-9d87-b3b54fe1240d to /dev/vdb
Aug 10 01:52:08 user nova-compute[73029]: DEBUG os_brick.utils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e454be78-5840-46e0-abb4-bb2a00267301]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7ac990d8bf15\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9502ce-7f68-46af-ae2d-35bdf16f4aa1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1cb0c9-60cd-4197-8e5a-68093790063a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e766c76-6162-46df-8f5d-040f26435df9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Running cmd (subprocess): nvme version {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] 'nvme version' failed. Not Retrying. {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] nvme not present on system {{(pid=73029) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 10 01:52:08 user nova-compute[73029]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 10 01:52:08 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e391ee5-f823-44ed-a346-32e742f57160]: (4, '') {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73029) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.lightos [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] LIGHTOS: no hostnqn found. {{(pid=73029) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG os_brick.utils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7ac990d8bf15', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG nova.virt.block_device [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating existing volume attachment record: 7b109e94-3250-4c13-bc92-f4a9192ddf95 {{(pid=73029) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 10 01:52:08 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:13 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Calling os-brick to attach iSCSI Volume {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btZzFLiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:52:16 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:52:16 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:52:16 user nova-compute[73029]: INFO os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[399d038f-5505-4c2e-97b7-040e23d109f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 10 01:52:16 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --interface default --op new {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f6b32d-0c41-4bd6-87e5-b3803d5dbf2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d] added\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d] added
Aug 10 01:52:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de152ed-867d-451f-b095-aa50531dcc56]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26be1fd-11d9-4ffd-999d-df4fd2508c8d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btZzFLiS {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btZzFLiS" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eb5b21-78c1-4919-ad83-ab9757a1a74d]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btZzFLiS'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[54060053-72e6-465c-af32-4572b6321ae1]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ed9404-434d-42bb-a6c7-25bf385c922c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:52:16 user nova-compute[73029]:  {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 10 01:52:16 user nova-compute[73029]:  {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:52:16 user nova-compute[73029]: WARNING os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 10 01:52:16 user nova-compute[73029]: 
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --login {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2befaf37-5f05-4581-8641-f09b07c6f05f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d, portal: 172.16.0.220,3260]
Aug 10 01:52:16 user nova-compute[73029]: Login to [iface: default, target: iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d, portal: 172.16.0.220,3260] successful.
Aug 10 01:52:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[078cf22b-89c1-495d-bb90-73bb4bf7f253]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6250232-35ae-4d93-8d4c-dd52efcbd49d]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d (non-flash)
Aug 10 01:52:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d (non-flash)
Aug 10 01:52:16 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Connected to 172.16.0.220:3260 {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73029) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73029) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d469f5-f80b-46f5-ab5c-1dda9468983c]: (4, ('- - 0', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:16 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73029) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btZzFLiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73029) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23965363936326136', 'path': '/dev/sdb'} {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965363936326136', 'path': '/dev/sdb'} {{(pid=73029) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG nova.objects.instance [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] attach device xml: <disk type="block" device="disk">
Aug 10 01:52:17 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:52:17 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:52:17 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:52:17 user nova-compute[73029]:   <serial>33482417-1fd0-4e3c-9d87-b3b54fe1240d</serial>
Aug 10 01:52:17 user nova-compute[73029]: </disk>
Aug 10 01:52:17 user nova-compute[73029]:  {{(pid=73029) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73029) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] No VIF found with MAC fa:16:3e:57:e3:19, not building metadata {{(pid=73029) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 10 01:52:17 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-6b3a1779-72df-48e6-972a-4185e585c1c6 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.874s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:52:18 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:18 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:52:20 user nova-compute[73029]: INFO nova.compute.manager [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Detaching volume 33482417-1fd0-4e3c-9d87-b3b54fe1240d
Aug 10 01:52:20 user nova-compute[73029]: INFO nova.virt.block_device [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Attempting to driver detach volume 33482417-1fd0-4e3c-9d87-b3b54fe1240d from mountpoint /dev/vdb
Aug 10 01:52:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Attempting to detach device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the persistent domain config. {{(pid=73029) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:52:20 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:52:20 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:52:20 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:52:20 user nova-compute[73029]:   <serial>33482417-1fd0-4e3c-9d87-b3b54fe1240d</serial>
Aug 10 01:52:20 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:52:20 user nova-compute[73029]: </disk>
Aug 10 01:52:20 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:52:20 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully detached device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the persistent domain config.
Aug 10 01:52:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the live domain config. {{(pid=73029) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.guest [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] detach device xml: <disk type="block" device="disk">
Aug 10 01:52:20 user nova-compute[73029]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 10 01:52:20 user nova-compute[73029]:   <source dev="/dev/sdb"/>
Aug 10 01:52:20 user nova-compute[73029]:   <target dev="vdb" bus="virtio"/>
Aug 10 01:52:20 user nova-compute[73029]:   <serial>33482417-1fd0-4e3c-9d87-b3b54fe1240d</serial>
Aug 10 01:52:20 user nova-compute[73029]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 10 01:52:20 user nova-compute[73029]: </disk>
Aug 10 01:52:20 user nova-compute[73029]:  {{(pid=73029) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-fb2f4b07-6d96-428f-8f85-dd87399a0b10 None None] Received event <DeviceRemovedEvent: 1691632340.8499892, f8d61c85-345b-4f89-8f94-63041570edc9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73029) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.driver [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 10 01:52:20 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully detached device vdb from instance f8d61c85-345b-4f89-8f94-63041570edc9 from the live domain config.
Aug 10 01:52:20 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] calling os-brick to detach iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7514571330>, {'target_iqns': ['iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btZzFLiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 10 01:52:20 user nova-compute[73029]: WARNING os_brick.initiator.connectors.base [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d', 0)] {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf95531-7919-4e12-ba30-e033bff2e8e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a7047d-81fe-4e5f-9f79-512b1d604743]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d (non-flash)\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d (non-flash)
Aug 10 01:52:20 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d (non-flash)
Aug 10 01:52:20 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74f0611990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d'): ({'sdb'}, set())}) {{(pid=73029) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Removing single pathed devices sdb {{(pid=73029) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d1596c-a652-4bce-ad41-dc78e95dec31]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0878d4-8b0a-4645-8819-90b77e2867de]: (4, ('ok\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Flushing IO for device /dev/sdb {{(pid=73029) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77fb34f-9dd6-43de-95a0-ec917715984a]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73029) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 10 01:52:20 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[801411b3-c5cc-400c-b1af-38cf04398183]: (4, ('1', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG os_brick.initiator.linuxscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] SCSI volumes sdb have been removed. {{(pid=73029) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d')] {{(pid=73029) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4c3337-bcdc-4104-9816-c0f765cfeae4]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --logout {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[836abb7a-530f-432a-9e5d-cfa7532b233e]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d, portal: 172.16.0.220,3260]
Aug 10 01:52:21 user nova-compute[73029]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d, portal: 172.16.0.220,3260] successful.
Aug 10 01:52:21 user nova-compute[73029]:  stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op delete {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33482417-1fd0-4e3c-9d87-b3b54fe1240d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84041) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo.privsep.daemon [-] privsep: reply[967a09a5-3623-4009-bcad-341f8cc0c90f]: (4, ('', '')) {{(pid=84041) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73029) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.base [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] <== disconnect_volume: return (245ms) None {{(pid=73029) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Disconnected iSCSI Volume {{(pid=73029) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG nova.objects.instance [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'flavor' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:52:21 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-51b02f47-675c-4827-b0b1-f2136ce04d4d tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.601s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:52:23 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:52:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:52:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:52:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:32 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:52:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:52:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:52:35 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:52:35 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:52:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.93197250366211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f8d61c85-345b-4f89-8f94-63041570edc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing inventories for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating ProviderTree inventory for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Updating inventory in ProviderTree for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 10 01:52:35 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing aggregate associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, aggregates: None {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 10 01:52:36 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Refreshing trait associations for resource provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND {{(pid=73029) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 10 01:52:36 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:52:36 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:52:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:52:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:52:37 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:52:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:52:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:52:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:52:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:52:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:50 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 10 01:52:50 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] There are 0 instances to clean {{(pid=73029) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 10 01:52:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:52:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:52:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:54 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:52:57 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:52:57 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73029) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 10 01:52:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:52:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:52:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:52:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:52:59 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:53:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:53:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:53:04 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:09 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:12 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:53:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:53:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:53:14 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:53:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:53:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:53:19 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:20 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:53:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:53:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:53:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:53:24 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:28 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:29 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquired lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Forcefully refreshing network info cache for instance {{(pid=73029) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG nova.objects.instance [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lazy-loading 'info_cache' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG nova.network.neutron [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [{"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Releasing lock "refresh_cache-f8d61c85-345b-4f89-8f94-63041570edc9" {{(pid=73029) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 10 01:53:33 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updated the network info_cache for instance {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 10 01:53:34 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:34 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_concurrency.processutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73029) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 10 01:53:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:53:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:53:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=24.931137084960938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Instance f8d61c85-345b-4f89-8f94-63041570edc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73029) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:53:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:53:37 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:53:37 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:53:37 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:53:37 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:53:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:53:39 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:53:49 user nova-compute[73029]: INFO nova.compute.manager [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Terminating instance
Aug 10 01:53:49 user nova-compute[73029]: DEBUG nova.compute.manager [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Start destroying the instance on the hypervisor. {{(pid=73029) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-74916f27-604c-4260-86d9-d3c1db805359 req-69c5d1c4-a06c-41d6-b021-a201cc212d20 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received event network-vif-unplugged-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-74916f27-604c-4260-86d9-d3c1db805359 req-69c5d1c4-a06c-41d6-b021-a201cc212d20 service nova] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-74916f27-604c-4260-86d9-d3c1db805359 req-69c5d1c4-a06c-41d6-b021-a201cc212d20 service nova] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-74916f27-604c-4260-86d9-d3c1db805359 req-69c5d1c4-a06c-41d6-b021-a201cc212d20 service nova] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-74916f27-604c-4260-86d9-d3c1db805359 req-69c5d1c4-a06c-41d6-b021-a201cc212d20 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] No waiting events found dispatching network-vif-unplugged-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:53:49 user nova-compute[73029]: DEBUG nova.compute.manager [req-74916f27-604c-4260-86d9-d3c1db805359 req-69c5d1c4-a06c-41d6-b021-a201cc212d20 service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received event network-vif-unplugged-9b752213-8099-492c-92c6-ac55ee922355 for instance with task_state deleting. {{(pid=73029) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [-] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Instance destroyed successfully.
Aug 10 01:53:50 user nova-compute[73029]: DEBUG nova.objects.instance [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lazy-loading 'resources' on Instance uuid f8d61c85-345b-4f89-8f94-63041570edc9 {{(pid=73029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG nova.virt.libvirt.vif [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-10T01:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1272785431',display_name='tempest-SnapshotDataIntegrityTests-server-1272785431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1272785431',id=52,image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF2b41aLIKzgNbLRBKzFNxDQKVT2Gs9tUlDSnOiR4xMpRg7H86vHjGKe8s+M6cOBTcjRT06R/b1GvKVMt4I49g/GfEaWtymHDBW3L9FaI/fZ5YkD6FPiGcBpK5eIp22iQ==',key_name='tempest-keypair-1838588018',keypairs=<?>,launch_index=0,launched_at=2023-08-10T01:46:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e59a39c2fee64557ba443528a6743162',ramdisk_id='',reservation_id='r-7wu0jhvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48fbc2bc-b0d2-49bf-97dd-ed057d979427',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2044714506',owner_user_name='tempest-SnapshotDataIntegrityTests-2044714506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-10T01:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57c45789bf604c068eb0d8712aa356eb',uuid=f8d61c85-345b-4f89-8f94-63041570edc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Converting VIF {"id": "9b752213-8099-492c-92c6-ac55ee922355", "address": "fa:16:3e:57:e3:19", "network": {"id": "d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443370653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e59a39c2fee64557ba443528a6743162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b752213-80", "ovs_interfaceid": "9b752213-8099-492c-92c6-ac55ee922355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG nova.network.os_vif_util [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:e3:19,bridge_name='br-int',has_traffic_filtering=True,id=9b752213-8099-492c-92c6-ac55ee922355,network=Network(d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b752213-80') {{(pid=73029) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG os_vif [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:e3:19,bridge_name='br-int',has_traffic_filtering=True,id=9b752213-8099-492c-92c6-ac55ee922355,network=Network(d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b752213-80') {{(pid=73029) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b752213-80, bridge=br-int, if_exists=True) {{(pid=73029) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:53:50 user nova-compute[73029]: INFO os_vif [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:e3:19,bridge_name='br-int',has_traffic_filtering=True,id=9b752213-8099-492c-92c6-ac55ee922355,network=Network(d6ed0ad1-4ae5-4731-a1bf-ad90e24ffc17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b752213-80')
Aug 10 01:53:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Deleting instance files /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9_del
Aug 10 01:53:50 user nova-compute[73029]: INFO nova.virt.libvirt.driver [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Deletion of /opt/stack/data/nova/instances/f8d61c85-345b-4f89-8f94-63041570edc9_del complete
Aug 10 01:53:50 user nova-compute[73029]: INFO nova.compute.manager [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 10 01:53:50 user nova-compute[73029]: DEBUG oslo.service.loopingcall [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73029) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG nova.compute.manager [-] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Deallocating network for instance {{(pid=73029) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 10 01:53:50 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] deallocate_for_instance() {{(pid=73029) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG nova.network.neutron [-] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Updating instance_info_cache with network_info: [] {{(pid=73029) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 10 01:53:51 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Took 1.01 seconds to deallocate network for instance.
Aug 10 01:53:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-9651e918-8ee6-4a7b-8828-bedb919221c7 req-5f01ca9f-49b7-49dc-9844-237c72a6128f service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received event network-vif-deleted-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:53:51 user nova-compute[73029]: INFO nova.scheduler.client.report [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Deleted allocations for instance f8d61c85-345b-4f89-8f94-63041570edc9
Aug 10 01:53:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-e5e28834-edcd-4f7e-9457-6eb24566b213 tempest-SnapshotDataIntegrityTests-2044714506 tempest-SnapshotDataIntegrityTests-2044714506-project-member] Lock "f8d61c85-345b-4f89-8f94-63041570edc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.377s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-326a69ee-de68-4e54-b688-892e3d6e014a req-112db1a2-9f19-4d7d-9d0c-437a3676861a service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received event network-vif-plugged-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-326a69ee-de68-4e54-b688-892e3d6e014a req-112db1a2-9f19-4d7d-9d0c-437a3676861a service nova] Acquiring lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-326a69ee-de68-4e54-b688-892e3d6e014a req-112db1a2-9f19-4d7d-9d0c-437a3676861a service nova] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [req-326a69ee-de68-4e54-b688-892e3d6e014a req-112db1a2-9f19-4d7d-9d0c-437a3676861a service nova] Lock "f8d61c85-345b-4f89-8f94-63041570edc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:53:51 user nova-compute[73029]: DEBUG nova.compute.manager [req-326a69ee-de68-4e54-b688-892e3d6e014a req-112db1a2-9f19-4d7d-9d0c-437a3676861a service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] No waiting events found dispatching network-vif-plugged-9b752213-8099-492c-92c6-ac55ee922355 {{(pid=73029) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 10 01:53:51 user nova-compute[73029]: WARNING nova.compute.manager [req-326a69ee-de68-4e54-b688-892e3d6e014a req-112db1a2-9f19-4d7d-9d0c-437a3676861a service nova] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Received unexpected event network-vif-plugged-9b752213-8099-492c-92c6-ac55ee922355 for instance with vm_state deleted and task_state None.
Aug 10 01:53:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:54:05 user nova-compute[73029]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691632430.18692, f8d61c85-345b-4f89-8f94-63041570edc9 => Stopped> {{(pid=73029) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 10 01:54:05 user nova-compute[73029]: INFO nova.compute.manager [-] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] VM Stopped (Lifecycle Event)
Aug 10 01:54:05 user nova-compute[73029]: DEBUG nova.compute.manager [None req-969b1e01-0384-4c7a-a2b7-0bf96e9715ed None None] [instance: f8d61c85-345b-4f89-8f94-63041570edc9] Checking state {{(pid=73029) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 10 01:54:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:54:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:54:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:54:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:54:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:15 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:20 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:22 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:24 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:24 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73029) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 10 01:54:25 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:54:29 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:30 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:54:34 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Starting heal instance info cache {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 10 01:54:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Rebuilding the list of instances to heal {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 10 01:54:35 user nova-compute[73029]: DEBUG nova.compute.manager [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Didn't find any instances for network info cache update. {{(pid=73029) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 10 01:54:35 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:35 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Auditing locally available compute resources for user (node: user) {{(pid=73029) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 10 01:54:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:54:36 user nova-compute[73029]: WARNING nova.virt.libvirt.driver [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 10 01:54:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=24.950714111328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73029) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73029) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG nova.compute.provider_tree [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed in ProviderTree for provider: 78a3d833-6e7b-46db-90d0-fe7329a0c19a {{(pid=73029) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG nova.scheduler.client.report [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Inventory has not changed for provider 78a3d833-6e7b-46db-90d0-fe7329a0c19a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73029) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG nova.compute.resource_tracker [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Compute_service record updated for user:user {{(pid=73029) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 10 01:54:36 user nova-compute[73029]: DEBUG oslo_concurrency.lockutils [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=73029) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 10 01:54:39 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:40 user nova-compute[73029]: DEBUG oslo_service.periodic_task [None req-0837a61c-4a01-4a02-bf26-7532bf839a95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73029) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 10 01:54:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:40 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:44 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:45 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:47 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:50 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:54:55 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:55:00 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:55:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:55:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:55:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73029) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 10 01:55:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:55:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 10 01:55:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73029) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 10 01:55:05 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 10 01:55:10 user nova-compute[73029]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73029) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}